Jul 27 13:27:25 user nova-compute[70914]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 27 13:27:28 user nova-compute[70914]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70914) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70914) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70914) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 13:27:28 user nova-compute[70914]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:27:28 user nova-compute[70914]: INFO nova.virt.driver [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 27 13:27:28 user nova-compute[70914]: INFO nova.compute.provider_config [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] Acquiring lock "singleton_lock" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] Acquired lock "singleton_lock" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] Releasing lock "singleton_lock" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] Full set of CONF: {{(pid=70914) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ******************************************************************************** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] Configuration options gathered from: {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ================================================================================ {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] allow_resize_to_same_host      = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] arq_binding_timeout            = 300 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] backdoor_port                  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] backdoor_socket                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] block_device_allocate_retries  = 300 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] block_device_allocate_retries_interval = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cert                           = self.pem {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute_monitors               = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] config_dir                     = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] config_drive_format            = iso9660 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] config_source                  = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] console_host                   = user {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] control_exchange               = nova {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cpu_allocation_ratio           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] daemon                         = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] debug                          = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] default_access_ip_network_name = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] default_availability_zone      = nova {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] default_ephemeral_format       = ext4 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] default_schedule_zone          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] disk_allocation_ratio          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] enable_new_services            = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] enabled_apis                   = ['osapi_compute'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] enabled_ssl_apis               = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] flat_injected                  = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] force_config_drive             = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] force_raw_images               = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] graceful_shutdown_timeout      = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] heal_instance_info_cache_interval = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] host                           = user {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] instance_build_timeout         = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] instance_delete_interval       = 300 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] instance_format                = [instance: %(uuid)s]  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] instance_name_template         = instance-%08x {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] instance_usage_audit           = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] instance_usage_audit_period    = month {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] internal_service_availability_zone = internal {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] key                            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] live_migration_retry_count     = 30 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] log_config_append              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] log_dir                        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] log_file                       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] log_options                    = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] log_rotate_interval            = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] log_rotate_interval_type       = days {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] log_rotation_type              = none {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] long_rpc_timeout               = 1800 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] max_concurrent_builds          = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] max_concurrent_live_migrations = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] max_concurrent_snapshots       = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] max_local_block_devices        = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] max_logfile_count              = 30 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] max_logfile_size_mb            = 200 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] maximum_instance_delete_attempts = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] metadata_listen                = 0.0.0.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] metadata_listen_port           = 8775 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] metadata_workers               = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] migrate_max_retries            = -1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] mkisofs_cmd                    = genisoimage {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] my_ip                          = 10.0.0.210 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] network_allocate_retries       = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] osapi_compute_listen_port      = 8774 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] osapi_compute_unique_server_name_scope =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] osapi_compute_workers          = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] password_length                = 12 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] periodic_enable                = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] periodic_fuzzy_delay           = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] pointer_model                  = ps2mouse {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] preallocate_images             = none {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] publish_errors                 = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] pybasedir                      = /opt/stack/nova {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ram_allocation_ratio           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] rate_limit_burst               = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] rate_limit_except_level        = CRITICAL {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] rate_limit_interval            = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] reboot_timeout                 = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] reclaim_instance_interval      = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] record                         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] reimage_timeout_per_gb         = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] report_interval                = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] rescue_timeout                 = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] reserved_host_cpus             = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] reserved_host_disk_mb          = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] reserved_host_memory_mb        = 512 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] reserved_huge_pages            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] resize_confirm_window          = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] resize_fs_using_block_device   = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] resume_guests_state_on_host_boot = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] rpc_response_timeout           = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] run_external_periodic_tasks    = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] running_deleted_instance_action = reap {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] running_deleted_instance_poll_interval = 1800 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] running_deleted_instance_timeout = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler_instance_sync_interval = 120 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_down_time              = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] servicegroup_driver            = db {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] shelved_offload_time           = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] shelved_poll_interval          = 3600 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] shutdown_timeout               = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] source_is_ipv6                 = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ssl_only                       = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] state_path                     = /opt/stack/data/nova {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] sync_power_state_interval      = 600 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] sync_power_state_pool_size     = 1000 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] syslog_log_facility            = LOG_USER {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] tempdir                        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] timeout_nbd                    = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] transport_url                  = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] update_resources_interval      = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] use_cow_images                 = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] use_eventlog                   = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] use_journal                    = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] use_json                       = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] use_rootwrap_daemon            = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] use_stderr                     = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] use_syslog                     = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vcpu_pin_set                   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plugging_is_fatal          = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plugging_timeout           = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] virt_mkfs                      = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] volume_usage_poll_interval     = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] watch_log_file                 = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] web                            = /usr/share/spice-html5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_concurrency.disable_process_locking = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.auth_strategy              = keystone {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.compute_link_prefix        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.dhcp_domain                = novalocal {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.enable_instance_password   = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.glance_link_prefix         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.instance_list_per_project_cells = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.list_records_by_skipping_down_cells = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.local_metadata_per_cell    = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.max_limit                  = 1000 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.metadata_cache_expiration  = 15 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.neutron_default_tenant_id  = default {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.use_forwarded_for          = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.use_neutron_default_nets   = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.vendordata_dynamic_targets = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.vendordata_jsonfile_path   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.backend                  = dogpile.cache.memcached {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.backend_argument         = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.config_prefix            = cache.oslo {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.dead_timeout             = 60.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.debug_cache_backend      = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.enable_retry_client      = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.enable_socket_keepalive  = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.enabled                  = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.expiration_time          = 600 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.hashclient_retry_attempts = 2 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.memcache_dead_retry      = 300 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.memcache_password        =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.memcache_pool_maxsize    = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.memcache_sasl_enabled    = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.memcache_username        =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.proxies                  = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.retry_attempts           = 2 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.retry_delay              = 0.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.socket_keepalive_count   = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.socket_keepalive_idle    = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.socket_keepalive_interval = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.tls_allowed_ciphers      = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.tls_cafile               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.tls_certfile             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.tls_enabled              = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cache.tls_keyfile              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.auth_section            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.auth_type               = password {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.cafile                  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.certfile                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.collect_timing          = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.cross_az_attach         = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.debug                   = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.endpoint_template       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.http_retries            = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.insecure                = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.keyfile                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.os_region_name          = RegionOne {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.split_loggers           = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cinder.timeout                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.cpu_dedicated_set      = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.cpu_shared_set         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.image_type_exclude_list = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.max_concurrent_disk_ops = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.max_disk_devices_to_attach = -1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.resource_provider_association_refresh = 300 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.shutdown_retry_interval = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] conductor.workers              = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] console.allowed_origins        = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] console.ssl_ciphers            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] console.ssl_minimum_version    = default {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] consoleauth.token_ttl          = 600 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.cafile                  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.certfile                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.collect_timing          = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.connect_retries         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.connect_retry_delay     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.endpoint_override       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.insecure                = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.keyfile                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.max_version             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.min_version             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.region_name             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.service_name            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.service_type            = accelerator {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.split_loggers           = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.status_code_retries     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.status_code_retry_delay = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.timeout                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] cyborg.version                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.backend               = sqlalchemy {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.connection            = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.connection_debug      = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.connection_parameters =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.connection_recycle_time = 3600 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.connection_trace      = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.db_inc_retry_interval = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.db_max_retries        = 20 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.db_max_retry_interval = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.db_retry_interval     = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.max_overflow          = 50 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.max_pool_size         = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.max_retries           = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.mysql_enable_ndb      = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.mysql_wsrep_sync_wait = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.pool_timeout          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.retry_interval        = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.slave_connection      = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] database.sqlite_synchronous    = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.backend           = sqlalchemy {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.connection        = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.connection_debug  = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.connection_parameters =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.connection_recycle_time = 3600 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.connection_trace  = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.db_inc_retry_interval = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.db_max_retries    = 20 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.db_max_retry_interval = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.db_retry_interval = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.max_overflow      = 50 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.max_pool_size     = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.max_retries       = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.mysql_enable_ndb  = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.pool_timeout      = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.retry_interval    = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.slave_connection  = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] api_database.sqlite_synchronous = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] devices.enabled_mdev_types     = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ephemeral_storage_encryption.enabled = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.api_servers             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.cafile                  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.certfile                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.collect_timing          = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.connect_retries         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.connect_retry_delay     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.debug                   = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.default_trusted_certificate_ids = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.enable_certificate_validation = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.enable_rbd_download     = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.endpoint_override       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.insecure                = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.keyfile                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.max_version             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.min_version             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.num_retries             = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.rbd_ceph_conf           =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.rbd_connect_timeout     = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.rbd_pool                =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.rbd_user                =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.region_name             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.service_name            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.service_type            = image {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.split_loggers           = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.status_code_retries     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.status_code_retry_delay = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.timeout                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.verify_glance_signatures = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] glance.version                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] guestfs.debug                  = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.config_drive_cdrom      = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.config_drive_inject_password = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.enable_instance_metrics_collection = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.enable_remotefx         = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.instances_path_share    =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.iscsi_initiator_list    = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.limit_cpu_features      = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.power_state_check_timeframe = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.use_multipath_io        = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.volume_attach_retry_count = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.vswitch_name            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] mks.enabled                    = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] image_cache.manager_interval   = 2400 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] image_cache.precache_concurrency = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] image_cache.remove_unused_base_images = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] image_cache.subdirectory_name  = _base {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.api_max_retries         = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.api_retry_interval      = 2 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.auth_section            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.auth_type               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.cafile                  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.certfile                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.collect_timing          = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.connect_retries         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.connect_retry_delay     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.endpoint_override       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.insecure                = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.keyfile                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.max_version             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.min_version             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.partition_key           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.peer_list               = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.region_name             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.serial_console_state_timeout = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.service_name            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.service_type            = baremetal {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.split_loggers           = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.status_code_retries     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.status_code_retry_delay = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.timeout                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ironic.version                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] key_manager.fixed_key          = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.barbican_api_version  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.barbican_endpoint     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.barbican_endpoint_type = public {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.barbican_region_name  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.cafile                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.certfile              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.collect_timing        = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.insecure              = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.keyfile               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.number_of_retries     = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.retry_delay           = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.send_service_user_token = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.split_loggers         = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.timeout               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.verify_ssl            = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican.verify_ssl_path       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican_service_user.auth_section = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican_service_user.auth_type = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican_service_user.cafile   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican_service_user.certfile = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican_service_user.collect_timing = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican_service_user.insecure = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican_service_user.keyfile  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican_service_user.split_loggers = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] barbican_service_user.timeout  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.approle_role_id          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.approle_secret_id        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.cafile                   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.certfile                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.collect_timing           = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.insecure                 = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.keyfile                  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.kv_mountpoint            = secret {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.kv_version               = 2 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.namespace                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.root_token_id            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.split_loggers            = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.ssl_ca_crt_file          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.timeout                  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.use_ssl                  = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.cafile                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.certfile              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.collect_timing        = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.connect_retries       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.connect_retry_delay   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.endpoint_override     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.insecure              = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.keyfile               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.max_version           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.min_version           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.region_name           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.service_name          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.service_type          = identity {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.split_loggers         = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.status_code_retries   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.status_code_retry_delay = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.timeout               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] keystone.version               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.connection_uri         =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.cpu_mode               = custom {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: WARNING oslo_config.cfg [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.cpu_power_governor_high = performance {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.cpu_power_governor_low = powersave {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.cpu_power_management   = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.device_detach_attempts = 8 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.device_detach_timeout  = 20 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.disk_cachemodes        = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.disk_prefix            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.enabled_perf_events    = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.file_backed_memory     = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.gid_maps               = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.hw_disk_discard        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.hw_machine_type        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.images_rbd_glance_store_name =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.images_rbd_pool        = rbd {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.images_type            = default {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.images_volume_group    = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.inject_key             = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.inject_partition       = -2 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.inject_password        = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.iscsi_iface            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.iser_use_multipath     = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_bandwidth = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_downtime = 500 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_inbound_addr = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_permit_post_copy = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_scheme  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_timeout_action = abort {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_tunnelled = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: WARNING oslo_config.cfg [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 27 13:27:28 user nova-compute[70914]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 27 13:27:28 user nova-compute[70914]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 27 13:27:28 user nova-compute[70914]: and ``live_migration_inbound_addr`` respectively.
Jul 27 13:27:28 user nova-compute[70914]: ).  Its value may be silently ignored in the future.
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.live_migration_with_native_tls = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.max_queues             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.nfs_mount_options      = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.num_memory_encrypted_guests = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:28 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.num_pcie_ports         = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.pmem_namespaces        = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.quobyte_client_cfg     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.rbd_secret_uuid        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.rbd_user               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.remote_filesystem_transport = ssh {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.rescue_image_id        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.rescue_kernel_id       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.rescue_ramdisk_id      = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.rx_queue_size          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.smbfs_mount_options    =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.snapshot_compression   = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.snapshot_image_format  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.sparse_logical_volumes = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.swtpm_enabled          = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.swtpm_group            = tss {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.swtpm_user             = tss {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.sysinfo_serial         = unique {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.tb_cache_size          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.tx_queue_size          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.uid_maps               = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.use_virtio_for_bridges = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.virt_type              = kvm {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.volume_clear           = zero {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.volume_clear_size      = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.volume_use_multipath   = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.vzstorage_cache_path   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.vzstorage_mount_user   = stack {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.auth_section           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.auth_type              = password {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.cafile                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.certfile               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.collect_timing         = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.connect_retries        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.connect_retry_delay    = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.default_floating_pool  = public {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.endpoint_override      = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.extension_sync_interval = 600 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.http_retries           = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.insecure               = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.keyfile                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.max_version            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.min_version            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.ovs_bridge             = br-int {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.physnets               = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.region_name            = RegionOne {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.service_metadata_proxy = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.service_name           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.service_type           = network {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.split_loggers          = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.status_code_retries    = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.status_code_retry_delay = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.timeout                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] neutron.version                = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] notifications.bdms_in_notifications = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] notifications.default_level    = INFO {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] notifications.notification_format = unversioned {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] notifications.notify_on_state_change = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] pci.alias                      = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] pci.device_spec                = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] pci.report_in_placement        = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.auth_section         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.auth_type            = password {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.cafile               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.certfile             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.collect_timing       = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.connect_retries      = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.connect_retry_delay  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.default_domain_id    = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.default_domain_name  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.domain_id            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.domain_name          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.endpoint_override    = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.insecure             = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.keyfile              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.max_version          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.min_version          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.password             = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.project_domain_id    = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.project_domain_name  = Default {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.project_id           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.project_name         = service {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.region_name          = RegionOne {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.service_name         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.service_type         = placement {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.split_loggers        = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.status_code_retries  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.status_code_retry_delay = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.system_scope         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.timeout              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.trust_id             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.user_domain_id       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.user_domain_name     = Default {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.user_id              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.username             = placement {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] placement.version              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.cores                    = 20 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.count_usage_from_placement = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.injected_file_content_bytes = 10240 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.injected_file_path_length = 255 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.injected_files           = 5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.instances                = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.key_pairs                = 100 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.metadata_items           = 128 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.ram                      = 51200 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.recheck_quota            = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.server_group_members     = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] quota.server_groups            = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] rdp.enabled                    = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.image_metadata_prefilter = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.max_attempts         = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.max_placement_results = 1000 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.query_placement_for_availability_zone = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.query_placement_for_image_type_support = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] scheduler.workers              = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.host_subset_size = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.isolated_hosts = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.isolated_images = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.pci_in_placement = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.track_instance_changes = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] metrics.required               = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] metrics.weight_multiplier      = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] metrics.weight_setting         = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] serial_console.enabled         = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] serial_console.port_range      = 10000:20000 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] serial_console.serialproxy_port = 6083 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_user.auth_section      = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_user.auth_type         = password {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_user.cafile            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_user.certfile          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_user.collect_timing    = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_user.insecure          = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_user.keyfile           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_user.send_service_user_token = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_user.split_loggers     = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] service_user.timeout           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.agent_enabled            = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.enabled                  = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.html5proxy_port          = 6082 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.image_compression        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.jpeg_compression         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.playback_compression     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.server_listen            = 127.0.0.1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.streaming_mode           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] spice.zlib_compression         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] upgrade_levels.baseapi         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] upgrade_levels.cert            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] upgrade_levels.compute         = auto {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] upgrade_levels.conductor       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] upgrade_levels.scheduler       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vendordata_dynamic_auth.auth_section = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vendordata_dynamic_auth.auth_type = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vendordata_dynamic_auth.cafile = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vendordata_dynamic_auth.certfile = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vendordata_dynamic_auth.insecure = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vendordata_dynamic_auth.keyfile = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vendordata_dynamic_auth.timeout = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.api_retry_count         = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.ca_file                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.cache_prefix            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.cluster_name            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.connection_pool_size    = 10 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.console_delay_seconds   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.datastore_regex         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.host_ip                 = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.host_password           = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.host_port               = 443 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.host_username           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.insecure                = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.integration_bridge      = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.maximum_objects         = 100 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.pbm_default_policy      = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.pbm_enabled             = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.pbm_wsdl_location       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.serial_port_proxy_uri   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.serial_port_service_uri = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.task_poll_interval      = 0.5 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.use_linked_clone        = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.vnc_keymap              = en-us {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.vnc_port                = 5900 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vmware.vnc_port_total          = 10000 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vnc.auth_schemes               = ['none'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vnc.enabled                    = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vnc.novncproxy_port            = 6080 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vnc.server_listen              = 0.0.0.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vnc.vencrypt_ca_certs          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vnc.vencrypt_client_cert       = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vnc.vencrypt_client_key        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.disable_rootwrap   = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.enable_numa_live_migration = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.libvirt_disable_apic = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.client_socket_timeout     = 900 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.default_pool_size         = 1000 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.keep_alive                = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.max_header_line           = 16384 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.ssl_ca_file               = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.ssl_cert_file             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.ssl_key_file              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.tcp_keepidle              = 600 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] zvm.ca_file                    = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] zvm.cloud_connector_url        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] zvm.reachable_timeout          = 300 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_policy.enforce_new_defaults = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_policy.enforce_scope      = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_policy.policy_default_rule = default {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_policy.policy_file        = policy.yaml {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.connection_string     = messaging:// {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.enabled               = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.es_doc_type           = notification {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.es_scroll_size        = 10000 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.es_scroll_time        = 2m {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.filter_error_trace    = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.hmac_keys             = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.sentinel_service_name = mymaster {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.socket_timeout        = 0.1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.trace_requests        = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler.trace_sqlalchemy      = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler_jaeger.process_tags   = {} {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler_jaeger.service_name_prefix = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] profiler_otlp.service_name_prefix = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] remote_debug.host              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] remote_debug.port              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.ssl      = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_notifications.retry = -1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_messaging_notifications.transport_url = **** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.auth_section        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.auth_type           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.cafile              = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.certfile            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.collect_timing      = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.connect_retries     = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.connect_retry_delay = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.endpoint_id         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.endpoint_override   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.insecure            = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.keyfile             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.max_version         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.min_version         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.region_name         = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.service_name        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.service_type        = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.split_loggers       = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.status_code_retries = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.status_code_retry_delay = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.timeout             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.valid_interfaces    = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_limit.version             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_reports.file_event_handler = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] oslo_reports.log_dir           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_ovs_privileged.group  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] vif_plug_ovs_privileged.user   = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_linux_bridge.flat_interface = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_ovs.isolate_vif         = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_vif_ovs.per_port_bridge     = False {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] os_brick.lock_path             = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] privsep_osbrick.capabilities   = [21] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] privsep_osbrick.group          = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] privsep_osbrick.helper_command = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] privsep_osbrick.user           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] nova_sys_admin.group           = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] nova_sys_admin.helper_command  = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] nova_sys_admin.user            = None {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG oslo_service.service [None req-141ba5a1-998c-4d2f-ac26-60c0a6554eed None None] ******************************************************************************** {{(pid=70914) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 27 13:27:29 user nova-compute[70914]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 27 13:27:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Starting native event thread {{(pid=70914) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Starting green dispatch thread {{(pid=70914) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Starting connection event dispatch thread {{(pid=70914) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Connecting to libvirt: qemu:///system {{(pid=70914) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f8c3f2bb7f0> {{(pid=70914) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 27 13:27:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f8c3f2bb7f0> {{(pid=70914) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 27 13:27:29 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Connection event '1' reason 'None'
Jul 27 13:27:29 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 27 13:27:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.mount [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Initialising _HostMountState generation 0 {{(pid=70914) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 27 13:27:36 user nova-compute[70914]: INFO nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Libvirt host capabilities <capabilities>
Jul 27 13:27:36 user nova-compute[70914]:   <host>
Jul 27 13:27:36 user nova-compute[70914]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 27 13:27:36 user nova-compute[70914]:     <cpu>
Jul 27 13:27:36 user nova-compute[70914]:       <arch>x86_64</arch>
Jul 27 13:27:36 user nova-compute[70914]:       <model>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <vendor>Intel</vendor>
Jul 27 13:27:36 user nova-compute[70914]:       <microcode version='1070'/>
Jul 27 13:27:36 user nova-compute[70914]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 27 13:27:36 user nova-compute[70914]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='ss'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='vmx'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='pcid'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='osxsave'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='hypervisor'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='arat'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='tsc_adjust'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='md-clear'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='arch-capabilities'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='invtsc'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='rsba'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature name='skip-l1dfl-vmentry'/>
Jul 27 13:27:36 user nova-compute[70914]:       <pages unit='KiB' size='4'/>
Jul 27 13:27:36 user nova-compute[70914]:       <pages unit='KiB' size='2048'/>
Jul 27 13:27:36 user nova-compute[70914]:     </cpu>
Jul 27 13:27:36 user nova-compute[70914]:     <power_management>
Jul 27 13:27:36 user nova-compute[70914]:       <suspend_mem/>
Jul 27 13:27:36 user nova-compute[70914]:       <suspend_disk/>
Jul 27 13:27:36 user nova-compute[70914]:       <suspend_hybrid/>
Jul 27 13:27:36 user nova-compute[70914]:     </power_management>
Jul 27 13:27:36 user nova-compute[70914]:     <iommu support='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     <migration_features>
Jul 27 13:27:36 user nova-compute[70914]:       <live/>
Jul 27 13:27:36 user nova-compute[70914]:       <uri_transports>
Jul 27 13:27:36 user nova-compute[70914]:         <uri_transport>tcp</uri_transport>
Jul 27 13:27:36 user nova-compute[70914]:         <uri_transport>rdma</uri_transport>
Jul 27 13:27:36 user nova-compute[70914]:       </uri_transports>
Jul 27 13:27:36 user nova-compute[70914]:     </migration_features>
Jul 27 13:27:36 user nova-compute[70914]:     <topology>
Jul 27 13:27:36 user nova-compute[70914]:       <cells num='2'>
Jul 27 13:27:36 user nova-compute[70914]:         <cell id='0'>
Jul 27 13:27:36 user nova-compute[70914]:           <memory unit='KiB'>8140616</memory>
Jul 27 13:27:36 user nova-compute[70914]:           <pages unit='KiB' size='4'>2035154</pages>
Jul 27 13:27:36 user nova-compute[70914]:           <pages unit='KiB' size='2048'>0</pages>
Jul 27 13:27:36 user nova-compute[70914]:           <distances>
Jul 27 13:27:36 user nova-compute[70914]:             <sibling id='0' value='10'/>
Jul 27 13:27:36 user nova-compute[70914]:             <sibling id='1' value='20'/>
Jul 27 13:27:36 user nova-compute[70914]:           </distances>
Jul 27 13:27:36 user nova-compute[70914]:           <cpus num='6'>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 27 13:27:36 user nova-compute[70914]:           </cpus>
Jul 27 13:27:36 user nova-compute[70914]:         </cell>
Jul 27 13:27:36 user nova-compute[70914]:         <cell id='1'>
Jul 27 13:27:36 user nova-compute[70914]:           <memory unit='KiB'>8255068</memory>
Jul 27 13:27:36 user nova-compute[70914]:           <pages unit='KiB' size='4'>2063767</pages>
Jul 27 13:27:36 user nova-compute[70914]:           <pages unit='KiB' size='2048'>0</pages>
Jul 27 13:27:36 user nova-compute[70914]:           <distances>
Jul 27 13:27:36 user nova-compute[70914]:             <sibling id='0' value='20'/>
Jul 27 13:27:36 user nova-compute[70914]:             <sibling id='1' value='10'/>
Jul 27 13:27:36 user nova-compute[70914]:           </distances>
Jul 27 13:27:36 user nova-compute[70914]:           <cpus num='6'>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 27 13:27:36 user nova-compute[70914]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 27 13:27:36 user nova-compute[70914]:           </cpus>
Jul 27 13:27:36 user nova-compute[70914]:         </cell>
Jul 27 13:27:36 user nova-compute[70914]:       </cells>
Jul 27 13:27:36 user nova-compute[70914]:     </topology>
Jul 27 13:27:36 user nova-compute[70914]:     <cache>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 27 13:27:36 user nova-compute[70914]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 27 13:27:36 user nova-compute[70914]:     </cache>
Jul 27 13:27:36 user nova-compute[70914]:     <secmodel>
Jul 27 13:27:36 user nova-compute[70914]:       <model>apparmor</model>
Jul 27 13:27:36 user nova-compute[70914]:       <doi>0</doi>
Jul 27 13:27:36 user nova-compute[70914]:     </secmodel>
Jul 27 13:27:36 user nova-compute[70914]:     <secmodel>
Jul 27 13:27:36 user nova-compute[70914]:       <model>dac</model>
Jul 27 13:27:36 user nova-compute[70914]:       <doi>0</doi>
Jul 27 13:27:36 user nova-compute[70914]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 27 13:27:36 user nova-compute[70914]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 27 13:27:36 user nova-compute[70914]:     </secmodel>
Jul 27 13:27:36 user nova-compute[70914]:   </host>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='alpha'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>clipper</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='armv6l'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>spitz</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>nuri</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>kzm</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sx1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>z2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>tosa</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>n810</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>n800</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>terrier</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>midway</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>microbit</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>verdex</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>highbank</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>akita</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>connex</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>collie</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='armv7l'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>spitz</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>nuri</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>kzm</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sx1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>z2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>tosa</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>n810</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>n800</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>terrier</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>midway</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>microbit</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>verdex</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>highbank</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>akita</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>connex</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>collie</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='aarch64'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>spitz</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>nuri</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>kzm</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sx1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>z2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>tosa</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>n810</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>n800</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>terrier</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>midway</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>microbit</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>verdex</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>raspi3b</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>highbank</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>akita</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>connex</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>collie</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <acpi default='on' toggle='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='cris'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='i686'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>x-remote</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>isapc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>microvm</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='kvm'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <pae/>
Jul 27 13:27:36 user nova-compute[70914]:       <nonpae/>
Jul 27 13:27:36 user nova-compute[70914]:       <acpi default='on' toggle='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:       <apic default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='m68k'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>an5206</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>q800</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>next-cube</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='microblaze'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='microblazeel'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='mips'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='16'>malta</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='mipsel'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='16'>malta</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='mips64'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='16'>malta</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>pica61</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>magnum</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='mips64el'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='16'>malta</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>pica61</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>magnum</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='16'>boston</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='ppc'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mac99</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>40p</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>taihu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='ppc64'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2048'>powernv9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>taihu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2048'>powernv10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>40p</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mac99</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2048'>powernv8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='ppc64le'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2048'>powernv9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>taihu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2048'>powernv10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>40p</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>mac99</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2048'>powernv8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='riscv32'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='8'>spike</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>opentitan</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='5'>sifive_u</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sifive_e</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='8'>virt</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='riscv64'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='8'>spike</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='5'>sifive_u</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>shakti_c</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sifive_e</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='8'>virt</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='s390x'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='sh4'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>shix</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>r2d</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='sh4eb'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>shix</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>r2d</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='sparc'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>SS-5</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>SS-20</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>LX</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>SS-4</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>SS-10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>Voyager</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='sparc64'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sun4u</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>niagara</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>sun4v</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='x86_64'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>64</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>x-remote</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='1'>isapc</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>microvm</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='kvm'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <acpi default='on' toggle='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:       <apic default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='xtensa'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>sim</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>kc705</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>ml605</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>virt</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>lx200</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>lx60</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]:   <guest>
Jul 27 13:27:36 user nova-compute[70914]:     <os_type>hvm</os_type>
Jul 27 13:27:36 user nova-compute[70914]:     <arch name='xtensaeb'>
Jul 27 13:27:36 user nova-compute[70914]:       <wordsize>32</wordsize>
Jul 27 13:27:36 user nova-compute[70914]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='4'>sim</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>kc705</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>ml605</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>virt</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>lx200</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>lx60</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 27 13:27:36 user nova-compute[70914]:       <domain type='qemu'/>
Jul 27 13:27:36 user nova-compute[70914]:     </arch>
Jul 27 13:27:36 user nova-compute[70914]:     <features>
Jul 27 13:27:36 user nova-compute[70914]:       <cpuselection/>
Jul 27 13:27:36 user nova-compute[70914]:       <deviceboot/>
Jul 27 13:27:36 user nova-compute[70914]:       <disksnapshot default='on' toggle='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     </features>
Jul 27 13:27:36 user nova-compute[70914]:   </guest>
Jul 27 13:27:36 user nova-compute[70914]: </capabilities>
Jul 27 13:27:36 user nova-compute[70914]: 
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 27 13:27:36 user nova-compute[70914]: <domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 13:27:36 user nova-compute[70914]:   <domain>kvm</domain>
Jul 27 13:27:36 user nova-compute[70914]:   <machine>pc-i440fx-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:   <arch>i686</arch>
Jul 27 13:27:36 user nova-compute[70914]:   <vcpu max='255'/>
Jul 27 13:27:36 user nova-compute[70914]:   <iothreads supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:   <os supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='firmware'/>
Jul 27 13:27:36 user nova-compute[70914]:     <loader supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>rom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pflash</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='readonly'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>yes</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='secure'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </loader>
Jul 27 13:27:36 user nova-compute[70914]:   </os>
Jul 27 13:27:36 user nova-compute[70914]:   <cpu>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-passthrough' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='hostPassthroughMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='maximum' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='maximumMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-model' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <vendor>Intel</vendor>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ss'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='vmx'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pcid'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='hypervisor'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arat'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='umip'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='md-clear'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibpb'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibrs'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='erms'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='lm'/>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='custom' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>qemu64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>qemu32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>phenom</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>n270</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>kvm64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>coreduo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>core2duo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>athlon</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Westmere</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Snowridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Penryn</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G5</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G4</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G1</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Nehalem</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Rome</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Milan</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Dhyana</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cooperlake</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Conroe</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>486</model>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:   </cpu>
Jul 27 13:27:36 user nova-compute[70914]:   <memoryBacking supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='sourceType'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>file</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>anonymous</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>memfd</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:   </memoryBacking>
Jul 27 13:27:36 user nova-compute[70914]:   <devices>
Jul 27 13:27:36 user nova-compute[70914]:     <disk supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='diskDevice'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>disk</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cdrom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>floppy</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>lun</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='bus'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ide</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>fdc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sata</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </disk>
Jul 27 13:27:36 user nova-compute[70914]:     <graphics supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sdl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vnc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>spice</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egl-headless</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </graphics>
Jul 27 13:27:36 user nova-compute[70914]:     <video supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='modelType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cirrus</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vmvga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>qxl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>none</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>bochs</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ramfb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </video>
Jul 27 13:27:36 user nova-compute[70914]:     <hostdev supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='mode'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>subsystem</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='startupPolicy'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>default</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>mandatory</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>requisite</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>optional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='subsysType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pci</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='capsType'/>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='pciBackend'/>
Jul 27 13:27:36 user nova-compute[70914]:     </hostdev>
Jul 27 13:27:36 user nova-compute[70914]:     <rng supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>random</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egd</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>builtin</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </rng>
Jul 27 13:27:36 user nova-compute[70914]:     <filesystem supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='driverType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>path</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>handle</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtiofs</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </filesystem>
Jul 27 13:27:36 user nova-compute[70914]:     <tpm supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-tis</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-crb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>passthrough</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>emulator</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </tpm>
Jul 27 13:27:36 user nova-compute[70914]:   </devices>
Jul 27 13:27:36 user nova-compute[70914]:   <features>
Jul 27 13:27:36 user nova-compute[70914]:     <gic supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     <vmcoreinfo supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <genid supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backingStoreInput supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backup supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <sev supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:   </features>
Jul 27 13:27:36 user nova-compute[70914]: </domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:  {{(pid=70914) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 27 13:27:36 user nova-compute[70914]: <domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 13:27:36 user nova-compute[70914]:   <domain>kvm</domain>
Jul 27 13:27:36 user nova-compute[70914]:   <machine>pc-q35-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:   <arch>i686</arch>
Jul 27 13:27:36 user nova-compute[70914]:   <vcpu max='288'/>
Jul 27 13:27:36 user nova-compute[70914]:   <iothreads supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:   <os supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='firmware'/>
Jul 27 13:27:36 user nova-compute[70914]:     <loader supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>rom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pflash</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='readonly'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>yes</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='secure'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </loader>
Jul 27 13:27:36 user nova-compute[70914]:   </os>
Jul 27 13:27:36 user nova-compute[70914]:   <cpu>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-passthrough' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='hostPassthroughMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='maximum' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='maximumMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-model' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <vendor>Intel</vendor>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ss'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='vmx'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pcid'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='hypervisor'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arat'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='umip'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='md-clear'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibpb'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibrs'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='erms'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='lm'/>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='custom' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>qemu64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>qemu32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>phenom</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>n270</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>kvm64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>coreduo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>core2duo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>athlon</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Westmere</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Snowridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Penryn</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G5</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G4</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G1</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Nehalem</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Rome</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Milan</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Dhyana</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cooperlake</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Conroe</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>486</model>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:   </cpu>
Jul 27 13:27:36 user nova-compute[70914]:   <memoryBacking supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='sourceType'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>file</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>anonymous</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>memfd</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:   </memoryBacking>
Jul 27 13:27:36 user nova-compute[70914]:   <devices>
Jul 27 13:27:36 user nova-compute[70914]:     <disk supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='diskDevice'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>disk</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cdrom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>floppy</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>lun</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='bus'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>fdc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sata</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </disk>
Jul 27 13:27:36 user nova-compute[70914]:     <graphics supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sdl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vnc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>spice</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egl-headless</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </graphics>
Jul 27 13:27:36 user nova-compute[70914]:     <video supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='modelType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cirrus</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vmvga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>qxl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>none</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>bochs</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ramfb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </video>
Jul 27 13:27:36 user nova-compute[70914]:     <hostdev supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='mode'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>subsystem</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='startupPolicy'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>default</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>mandatory</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>requisite</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>optional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='subsysType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pci</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='capsType'/>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='pciBackend'/>
Jul 27 13:27:36 user nova-compute[70914]:     </hostdev>
Jul 27 13:27:36 user nova-compute[70914]:     <rng supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>random</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egd</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>builtin</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </rng>
Jul 27 13:27:36 user nova-compute[70914]:     <filesystem supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='driverType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>path</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>handle</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtiofs</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </filesystem>
Jul 27 13:27:36 user nova-compute[70914]:     <tpm supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-tis</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-crb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>passthrough</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>emulator</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </tpm>
Jul 27 13:27:36 user nova-compute[70914]:   </devices>
Jul 27 13:27:36 user nova-compute[70914]:   <features>
Jul 27 13:27:36 user nova-compute[70914]:     <gic supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     <vmcoreinfo supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <genid supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backingStoreInput supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backup supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <sev supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:   </features>
Jul 27 13:27:36 user nova-compute[70914]: </domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:  {{(pid=70914) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 27 13:27:36 user nova-compute[70914]: <domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 13:27:36 user nova-compute[70914]:   <domain>kvm</domain>
Jul 27 13:27:36 user nova-compute[70914]:   <machine>pc-q35-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:   <arch>i686</arch>
Jul 27 13:27:36 user nova-compute[70914]:   <vcpu max='288'/>
Jul 27 13:27:36 user nova-compute[70914]:   <iothreads supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:   <os supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='firmware'/>
Jul 27 13:27:36 user nova-compute[70914]:     <loader supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>rom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pflash</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='readonly'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>yes</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='secure'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </loader>
Jul 27 13:27:36 user nova-compute[70914]:   </os>
Jul 27 13:27:36 user nova-compute[70914]:   <cpu>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-passthrough' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='hostPassthroughMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='maximum' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='maximumMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-model' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <vendor>Intel</vendor>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ss'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='vmx'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pcid'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='hypervisor'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arat'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='umip'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='md-clear'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibpb'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibrs'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='erms'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='lm'/>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='custom' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>qemu64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>qemu32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>phenom</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>n270</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>kvm64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>coreduo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>core2duo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>athlon</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Westmere</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Snowridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Penryn</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G5</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G4</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G1</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Nehalem</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Rome</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Milan</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Dhyana</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cooperlake</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Conroe</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>486</model>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:   </cpu>
Jul 27 13:27:36 user nova-compute[70914]:   <memoryBacking supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='sourceType'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>file</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>anonymous</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>memfd</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:   </memoryBacking>
Jul 27 13:27:36 user nova-compute[70914]:   <devices>
Jul 27 13:27:36 user nova-compute[70914]:     <disk supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='diskDevice'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>disk</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cdrom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>floppy</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>lun</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='bus'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>fdc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sata</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </disk>
Jul 27 13:27:36 user nova-compute[70914]:     <graphics supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sdl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vnc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>spice</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egl-headless</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </graphics>
Jul 27 13:27:36 user nova-compute[70914]:     <video supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='modelType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cirrus</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vmvga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>qxl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>none</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>bochs</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ramfb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </video>
Jul 27 13:27:36 user nova-compute[70914]:     <hostdev supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='mode'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>subsystem</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='startupPolicy'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>default</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>mandatory</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>requisite</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>optional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='subsysType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pci</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='capsType'/>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='pciBackend'/>
Jul 27 13:27:36 user nova-compute[70914]:     </hostdev>
Jul 27 13:27:36 user nova-compute[70914]:     <rng supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>random</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egd</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>builtin</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </rng>
Jul 27 13:27:36 user nova-compute[70914]:     <filesystem supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='driverType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>path</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>handle</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtiofs</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </filesystem>
Jul 27 13:27:36 user nova-compute[70914]:     <tpm supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-tis</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-crb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>passthrough</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>emulator</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </tpm>
Jul 27 13:27:36 user nova-compute[70914]:   </devices>
Jul 27 13:27:36 user nova-compute[70914]:   <features>
Jul 27 13:27:36 user nova-compute[70914]:     <gic supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     <vmcoreinfo supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <genid supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backingStoreInput supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backup supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <sev supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:   </features>
Jul 27 13:27:36 user nova-compute[70914]: </domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:  {{(pid=70914) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 27 13:27:36 user nova-compute[70914]: <domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 13:27:36 user nova-compute[70914]:   <domain>kvm</domain>
Jul 27 13:27:36 user nova-compute[70914]:   <machine>pc-i440fx-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:   <arch>i686</arch>
Jul 27 13:27:36 user nova-compute[70914]:   <vcpu max='255'/>
Jul 27 13:27:36 user nova-compute[70914]:   <iothreads supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:   <os supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='firmware'/>
Jul 27 13:27:36 user nova-compute[70914]:     <loader supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>rom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pflash</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='readonly'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>yes</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='secure'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </loader>
Jul 27 13:27:36 user nova-compute[70914]:   </os>
Jul 27 13:27:36 user nova-compute[70914]:   <cpu>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-passthrough' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='hostPassthroughMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='maximum' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='maximumMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-model' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <vendor>Intel</vendor>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ss'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='vmx'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pcid'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='hypervisor'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arat'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='umip'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='md-clear'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibpb'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibrs'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='erms'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='lm'/>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='custom' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>qemu64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>qemu32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>phenom</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>n270</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>kvm64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>coreduo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>core2duo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>athlon</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Westmere</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Snowridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Penryn</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G5</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G4</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G1</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Nehalem</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Rome</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Milan</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Dhyana</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cooperlake</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Conroe</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>486</model>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:   </cpu>
Jul 27 13:27:36 user nova-compute[70914]:   <memoryBacking supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='sourceType'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>file</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>anonymous</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>memfd</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:   </memoryBacking>
Jul 27 13:27:36 user nova-compute[70914]:   <devices>
Jul 27 13:27:36 user nova-compute[70914]:     <disk supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='diskDevice'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>disk</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cdrom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>floppy</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>lun</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='bus'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ide</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>fdc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sata</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </disk>
Jul 27 13:27:36 user nova-compute[70914]:     <graphics supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sdl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vnc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>spice</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egl-headless</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </graphics>
Jul 27 13:27:36 user nova-compute[70914]:     <video supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='modelType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cirrus</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vmvga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>qxl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>none</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>bochs</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ramfb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </video>
Jul 27 13:27:36 user nova-compute[70914]:     <hostdev supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='mode'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>subsystem</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='startupPolicy'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>default</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>mandatory</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>requisite</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>optional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='subsysType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pci</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='capsType'/>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='pciBackend'/>
Jul 27 13:27:36 user nova-compute[70914]:     </hostdev>
Jul 27 13:27:36 user nova-compute[70914]:     <rng supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>random</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egd</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>builtin</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </rng>
Jul 27 13:27:36 user nova-compute[70914]:     <filesystem supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='driverType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>path</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>handle</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtiofs</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </filesystem>
Jul 27 13:27:36 user nova-compute[70914]:     <tpm supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-tis</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-crb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>passthrough</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>emulator</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </tpm>
Jul 27 13:27:36 user nova-compute[70914]:   </devices>
Jul 27 13:27:36 user nova-compute[70914]:   <features>
Jul 27 13:27:36 user nova-compute[70914]:     <gic supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     <vmcoreinfo supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <genid supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backingStoreInput supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backup supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <sev supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:   </features>
Jul 27 13:27:36 user nova-compute[70914]: </domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:  {{(pid=70914) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 27 13:27:36 user nova-compute[70914]: <domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 13:27:36 user nova-compute[70914]:   <domain>kvm</domain>
Jul 27 13:27:36 user nova-compute[70914]:   <machine>pc-i440fx-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:   <arch>x86_64</arch>
Jul 27 13:27:36 user nova-compute[70914]:   <vcpu max='255'/>
Jul 27 13:27:36 user nova-compute[70914]:   <iothreads supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:   <os supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='firmware'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>efi</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:     <loader supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>rom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pflash</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='readonly'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>yes</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='secure'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </loader>
Jul 27 13:27:36 user nova-compute[70914]:   </os>
Jul 27 13:27:36 user nova-compute[70914]:   <cpu>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-passthrough' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='hostPassthroughMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='maximum' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='maximumMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-model' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <vendor>Intel</vendor>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ss'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='vmx'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pcid'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='hypervisor'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arat'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='umip'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='md-clear'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='invtsc'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibpb'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibrs'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='rsba'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='erms'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='custom' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>qemu64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>qemu32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>phenom</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>n270</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>coreduo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>core2duo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>athlon</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Westmere</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Snowridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Penryn</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G5</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G4</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Opteron_G1</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Nehalem</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Rome</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Milan</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Dhyana</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cooperlake</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Conroe</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>486</model>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:   </cpu>
Jul 27 13:27:36 user nova-compute[70914]:   <memoryBacking supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='sourceType'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>file</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>anonymous</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>memfd</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:   </memoryBacking>
Jul 27 13:27:36 user nova-compute[70914]:   <devices>
Jul 27 13:27:36 user nova-compute[70914]:     <disk supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='diskDevice'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>disk</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cdrom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>floppy</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>lun</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='bus'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ide</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>fdc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sata</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </disk>
Jul 27 13:27:36 user nova-compute[70914]:     <graphics supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sdl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vnc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>spice</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egl-headless</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </graphics>
Jul 27 13:27:36 user nova-compute[70914]:     <video supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='modelType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cirrus</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vmvga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>qxl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>none</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>bochs</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ramfb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </video>
Jul 27 13:27:36 user nova-compute[70914]:     <hostdev supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='mode'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>subsystem</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='startupPolicy'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>default</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>mandatory</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>requisite</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>optional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='subsysType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pci</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='capsType'/>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='pciBackend'/>
Jul 27 13:27:36 user nova-compute[70914]:     </hostdev>
Jul 27 13:27:36 user nova-compute[70914]:     <rng supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>random</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egd</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>builtin</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </rng>
Jul 27 13:27:36 user nova-compute[70914]:     <filesystem supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='driverType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>path</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>handle</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtiofs</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </filesystem>
Jul 27 13:27:36 user nova-compute[70914]:     <tpm supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-tis</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-crb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>passthrough</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>emulator</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </tpm>
Jul 27 13:27:36 user nova-compute[70914]:   </devices>
Jul 27 13:27:36 user nova-compute[70914]:   <features>
Jul 27 13:27:36 user nova-compute[70914]:     <gic supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     <vmcoreinfo supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <genid supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backingStoreInput supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backup supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <sev supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:   </features>
Jul 27 13:27:36 user nova-compute[70914]: </domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:  {{(pid=70914) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 27 13:27:36 user nova-compute[70914]: <domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 13:27:36 user nova-compute[70914]:   <domain>kvm</domain>
Jul 27 13:27:36 user nova-compute[70914]:   <machine>pc-q35-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:   <arch>x86_64</arch>
Jul 27 13:27:36 user nova-compute[70914]:   <vcpu max='288'/>
Jul 27 13:27:36 user nova-compute[70914]:   <iothreads supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:   <os supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='firmware'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>efi</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:     <loader supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>rom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pflash</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='readonly'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>yes</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='secure'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>yes</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </loader>
Jul 27 13:27:36 user nova-compute[70914]:   </os>
Jul 27 13:27:36 user nova-compute[70914]:   <cpu>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-passthrough' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='hostPassthroughMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='maximum' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='maximumMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-model' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <vendor>Intel</vendor>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ss'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='vmx'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pcid'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='hypervisor'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arat'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='umip'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='md-clear'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='invtsc'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibpb'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibrs'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='rsba'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='erms'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='custom' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>qemu64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>qemu32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>phenom</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>n270</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>coreduo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>core2duo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>athlon</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Westmere</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Snowridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Penryn</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G5</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G4</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Opteron_G1</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Nehalem</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Rome</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Milan</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Dhyana</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cooperlake</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Conroe</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>486</model>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:   </cpu>
Jul 27 13:27:36 user nova-compute[70914]:   <memoryBacking supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='sourceType'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>file</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>anonymous</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>memfd</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:   </memoryBacking>
Jul 27 13:27:36 user nova-compute[70914]:   <devices>
Jul 27 13:27:36 user nova-compute[70914]:     <disk supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='diskDevice'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>disk</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cdrom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>floppy</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>lun</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='bus'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>fdc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sata</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </disk>
Jul 27 13:27:36 user nova-compute[70914]:     <graphics supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sdl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vnc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>spice</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egl-headless</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </graphics>
Jul 27 13:27:36 user nova-compute[70914]:     <video supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='modelType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cirrus</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vmvga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>qxl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>none</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>bochs</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ramfb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </video>
Jul 27 13:27:36 user nova-compute[70914]:     <hostdev supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='mode'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>subsystem</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='startupPolicy'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>default</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>mandatory</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>requisite</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>optional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='subsysType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pci</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='capsType'/>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='pciBackend'/>
Jul 27 13:27:36 user nova-compute[70914]:     </hostdev>
Jul 27 13:27:36 user nova-compute[70914]:     <rng supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>random</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egd</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>builtin</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </rng>
Jul 27 13:27:36 user nova-compute[70914]:     <filesystem supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='driverType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>path</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>handle</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtiofs</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </filesystem>
Jul 27 13:27:36 user nova-compute[70914]:     <tpm supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-tis</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-crb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>passthrough</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>emulator</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </tpm>
Jul 27 13:27:36 user nova-compute[70914]:   </devices>
Jul 27 13:27:36 user nova-compute[70914]:   <features>
Jul 27 13:27:36 user nova-compute[70914]:     <gic supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     <vmcoreinfo supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <genid supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backingStoreInput supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backup supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <sev supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:   </features>
Jul 27 13:27:36 user nova-compute[70914]: </domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:  {{(pid=70914) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 27 13:27:36 user nova-compute[70914]: <domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 13:27:36 user nova-compute[70914]:   <domain>kvm</domain>
Jul 27 13:27:36 user nova-compute[70914]:   <machine>pc-q35-6.2</machine>
Jul 27 13:27:36 user nova-compute[70914]:   <arch>x86_64</arch>
Jul 27 13:27:36 user nova-compute[70914]:   <vcpu max='288'/>
Jul 27 13:27:36 user nova-compute[70914]:   <iothreads supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:   <os supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='firmware'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>efi</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:     <loader supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>rom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pflash</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='readonly'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>yes</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='secure'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>yes</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </loader>
Jul 27 13:27:36 user nova-compute[70914]:   </os>
Jul 27 13:27:36 user nova-compute[70914]:   <cpu>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-passthrough' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='hostPassthroughMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='maximum' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='maximumMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-model' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <vendor>Intel</vendor>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ss'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='vmx'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pcid'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='hypervisor'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arat'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='umip'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='md-clear'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='invtsc'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibpb'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibrs'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='rsba'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='erms'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='custom' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>qemu64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>qemu32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>phenom</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>n270</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>coreduo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>core2duo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>athlon</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Westmere</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Snowridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Penryn</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G5</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G4</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Opteron_G1</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Nehalem</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Rome</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Milan</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Dhyana</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cooperlake</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Conroe</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>486</model>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:   </cpu>
Jul 27 13:27:36 user nova-compute[70914]:   <memoryBacking supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='sourceType'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>file</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>anonymous</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>memfd</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:   </memoryBacking>
Jul 27 13:27:36 user nova-compute[70914]:   <devices>
Jul 27 13:27:36 user nova-compute[70914]:     <disk supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='diskDevice'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>disk</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cdrom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>floppy</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>lun</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='bus'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>fdc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sata</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </disk>
Jul 27 13:27:36 user nova-compute[70914]:     <graphics supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sdl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vnc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>spice</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egl-headless</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </graphics>
Jul 27 13:27:36 user nova-compute[70914]:     <video supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='modelType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cirrus</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vmvga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>qxl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>none</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>bochs</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ramfb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </video>
Jul 27 13:27:36 user nova-compute[70914]:     <hostdev supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='mode'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>subsystem</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='startupPolicy'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>default</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>mandatory</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>requisite</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>optional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='subsysType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pci</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='capsType'/>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='pciBackend'/>
Jul 27 13:27:36 user nova-compute[70914]:     </hostdev>
Jul 27 13:27:36 user nova-compute[70914]:     <rng supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>random</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egd</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>builtin</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </rng>
Jul 27 13:27:36 user nova-compute[70914]:     <filesystem supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='driverType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>path</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>handle</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtiofs</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </filesystem>
Jul 27 13:27:36 user nova-compute[70914]:     <tpm supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-tis</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-crb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>passthrough</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>emulator</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </tpm>
Jul 27 13:27:36 user nova-compute[70914]:   </devices>
Jul 27 13:27:36 user nova-compute[70914]:   <features>
Jul 27 13:27:36 user nova-compute[70914]:     <gic supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     <vmcoreinfo supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <genid supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backingStoreInput supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backup supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <sev supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:   </features>
Jul 27 13:27:36 user nova-compute[70914]: </domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:  {{(pid=70914) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 27 13:27:36 user nova-compute[70914]: <domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 13:27:36 user nova-compute[70914]:   <domain>kvm</domain>
Jul 27 13:27:36 user nova-compute[70914]:   <machine>pc-i440fx-jammy</machine>
Jul 27 13:27:36 user nova-compute[70914]:   <arch>x86_64</arch>
Jul 27 13:27:36 user nova-compute[70914]:   <vcpu max='255'/>
Jul 27 13:27:36 user nova-compute[70914]:   <iothreads supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:   <os supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='firmware'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>efi</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:     <loader supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>rom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pflash</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='readonly'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>yes</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='secure'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>no</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </loader>
Jul 27 13:27:36 user nova-compute[70914]:   </os>
Jul 27 13:27:36 user nova-compute[70914]:   <cpu>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-passthrough' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='hostPassthroughMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='maximum' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='maximumMigratable'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>on</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>off</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='host-model' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <vendor>Intel</vendor>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ss'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='vmx'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pcid'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='hypervisor'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arat'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='umip'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='md-clear'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='invtsc'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibpb'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='ibrs'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-stibp'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='rsba'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='erms'/>
Jul 27 13:27:36 user nova-compute[70914]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:     <mode name='custom' supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>qemu64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>qemu32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>phenom</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>pentium</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>n270</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm64</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>kvm32</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>coreduo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>core2duo</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>athlon</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Westmere</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Snowridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Skylake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>SandyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Penryn</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G5</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G4</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G3</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Opteron_G2</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Opteron_G1</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Nehalem</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>IvyBridge</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Icelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Haswell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Rome</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-Milan</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>EPYC</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Dhyana</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cooperlake</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>Conroe</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='no'>Broadwell</model>
Jul 27 13:27:36 user nova-compute[70914]:       <model usable='yes'>486</model>
Jul 27 13:27:36 user nova-compute[70914]:     </mode>
Jul 27 13:27:36 user nova-compute[70914]:   </cpu>
Jul 27 13:27:36 user nova-compute[70914]:   <memoryBacking supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:     <enum name='sourceType'>
Jul 27 13:27:36 user nova-compute[70914]:       <value>file</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>anonymous</value>
Jul 27 13:27:36 user nova-compute[70914]:       <value>memfd</value>
Jul 27 13:27:36 user nova-compute[70914]:     </enum>
Jul 27 13:27:36 user nova-compute[70914]:   </memoryBacking>
Jul 27 13:27:36 user nova-compute[70914]:   <devices>
Jul 27 13:27:36 user nova-compute[70914]:     <disk supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='diskDevice'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>disk</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cdrom</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>floppy</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>lun</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='bus'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ide</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>fdc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sata</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </disk>
Jul 27 13:27:36 user nova-compute[70914]:     <graphics supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='type'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>sdl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vnc</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>spice</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egl-headless</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </graphics>
Jul 27 13:27:36 user nova-compute[70914]:     <video supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='modelType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>cirrus</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>vmvga</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>qxl</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>none</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>bochs</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>ramfb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </video>
Jul 27 13:27:36 user nova-compute[70914]:     <hostdev supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='mode'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>subsystem</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='startupPolicy'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>default</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>mandatory</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>requisite</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>optional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='subsysType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>usb</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>pci</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>scsi</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='capsType'/>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='pciBackend'/>
Jul 27 13:27:36 user nova-compute[70914]:     </hostdev>
Jul 27 13:27:36 user nova-compute[70914]:     <rng supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtio-non-transitional</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>random</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>egd</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>builtin</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </rng>
Jul 27 13:27:36 user nova-compute[70914]:     <filesystem supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='driverType'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>path</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>handle</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>virtiofs</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </filesystem>
Jul 27 13:27:36 user nova-compute[70914]:     <tpm supported='yes'>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='model'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-tis</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>tpm-crb</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:       <enum name='backendModel'>
Jul 27 13:27:36 user nova-compute[70914]:         <value>passthrough</value>
Jul 27 13:27:36 user nova-compute[70914]:         <value>emulator</value>
Jul 27 13:27:36 user nova-compute[70914]:       </enum>
Jul 27 13:27:36 user nova-compute[70914]:     </tpm>
Jul 27 13:27:36 user nova-compute[70914]:   </devices>
Jul 27 13:27:36 user nova-compute[70914]:   <features>
Jul 27 13:27:36 user nova-compute[70914]:     <gic supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:     <vmcoreinfo supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <genid supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backingStoreInput supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <backup supported='yes'/>
Jul 27 13:27:36 user nova-compute[70914]:     <sev supported='no'/>
Jul 27 13:27:36 user nova-compute[70914]:   </features>
Jul 27 13:27:36 user nova-compute[70914]: </domainCapabilities>
Jul 27 13:27:36 user nova-compute[70914]:  {{(pid=70914) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70914) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70914) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Checking secure boot support for host arch (x86_64) {{(pid=70914) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Checking secure boot support for host arch (x86_64) {{(pid=70914) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Checking secure boot support for host arch (x86_64) {{(pid=70914) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 13:27:36 user nova-compute[70914]: INFO nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Secure Boot support detected
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] cpu compare xml: <cpu match="exact">
Jul 27 13:27:36 user nova-compute[70914]:   <model>Nehalem</model>
Jul 27 13:27:36 user nova-compute[70914]: </cpu>
Jul 27 13:27:36 user nova-compute[70914]:  {{(pid=70914) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 27 13:27:36 user nova-compute[70914]: INFO nova.virt.node [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Generated node identity 28f9fcbc-7a25-483f-af71-8564174ecae0
Jul 27 13:27:36 user nova-compute[70914]: INFO nova.virt.node [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Wrote node identity 28f9fcbc-7a25-483f-af71-8564174ecae0 to /opt/stack/data/nova/compute_id
Jul 27 13:27:36 user nova-compute[70914]: WARNING nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Compute nodes ['28f9fcbc-7a25-483f-af71-8564174ecae0'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 27 13:27:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 27 13:27:36 user nova-compute[70914]: WARNING nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 27 13:27:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:27:36 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:27:37 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:27:37 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Hypervisor/Node resource view: name=user free_ram=10882MB free_disk=26.365306854248047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:27:37 user nova-compute[70914]: WARNING nova.compute.resource_tracker [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] No compute node record for user:28f9fcbc-7a25-483f-af71-8564174ecae0: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 28f9fcbc-7a25-483f-af71-8564174ecae0 could not be found.
Jul 27 13:27:37 user nova-compute[70914]: INFO nova.compute.resource_tracker [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Compute node record created for user:user with uuid: 28f9fcbc-7a25-483f-af71-8564174ecae0
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:27:37 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [req-88b22d97-d474-4b66-bd42-2f08b758d81a] Created resource provider record via placement API for resource provider with UUID 28f9fcbc-7a25-483f-af71-8564174ecae0 and name user.
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70914) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 27 13:27:37 user nova-compute[70914]: INFO nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] kernel doesn't support AMD SEV
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Libvirt baseline CPU <cpu>
Jul 27 13:27:37 user nova-compute[70914]:   <arch>x86_64</arch>
Jul 27 13:27:37 user nova-compute[70914]:   <model>Nehalem</model>
Jul 27 13:27:37 user nova-compute[70914]:   <vendor>Intel</vendor>
Jul 27 13:27:37 user nova-compute[70914]:   <topology sockets="6" cores="1" threads="1"/>
Jul 27 13:27:37 user nova-compute[70914]: </cpu>
Jul 27 13:27:37 user nova-compute[70914]:  {{(pid=70914) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Updated inventory for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Updating resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 generation from 0 to 1 during operation: update_inventory {{(pid=70914) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Updating resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 generation from 1 to 2 during operation: update_traits {{(pid=70914) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.819s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.service [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Creating RPC server for service compute {{(pid=70914) start /opt/stack/nova/nova/service.py:182}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.service [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Join ServiceGroup membership for this service compute {{(pid=70914) start /opt/stack/nova/nova/service.py:199}}
Jul 27 13:27:37 user nova-compute[70914]: DEBUG nova.servicegroup.drivers.db [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70914) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 27 13:28:27 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_power_states {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:27 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:28:28 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:28:28 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:28:28 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=10338MB free_disk=26.345596313476562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:28:28 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:28:29 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:28:29 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:28:29 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:28:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:29:29 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:29:30 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:29:30 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:29:30 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=10247MB free_disk=26.26220703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:29:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:29:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:29:30 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:29:30 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:29:30 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:29:30 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:29:30 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:29:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:29:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:29:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:29:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:29:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:30:29 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:30:29 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:30:29 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=10226MB free_disk=26.246261596679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:30:29 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:30:30 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:30:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:30:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:30:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:30:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 13:30:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 13:30:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:30:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:30:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:30:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:30:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:30:32 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:30:32 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:30:32 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:31:30 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:31:30 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:31:30 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:31:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:31:31 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:31:31 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:31:31 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=10265MB free_disk=26.08515167236328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:31:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.098s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:31:32 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:31:32 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:31:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:31:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 13:31:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 13:31:32 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:31:33 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:31:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "1b676522-c547-497a-9b3b-8436f85c7f40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:32:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:12 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:32:12 user nova-compute[70914]: INFO nova.compute.claims [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Claim successful on node user
Jul 27 13:32:12 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:32:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:32:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:32:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:32:13 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:32:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:32:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:32:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:32:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:32:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Creating image(s)
Jul 27 13:32:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:13 user nova-compute[70914]: DEBUG nova.policy [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0d92b0b34814e75a7709e09e357be07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b177edc7249f798bca2c39a33394d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:32:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d.part --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d.part --force-share --output=json" returned: 0 in 0.129s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:14 user nova-compute[70914]: DEBUG nova.virt.images [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] 33cbcfd9-c349-4c50-a3d9-7b9d8aca3776 was qcow2, converting to raw {{(pid=70914) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 13:32:14 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:32:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d.part /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d.converted {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d.part /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d.converted" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d.converted --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.274s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:14 user nova-compute[70914]: INFO oslo.privsep.daemon [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4w30_g0_/privsep.sock']
Jul 27 13:32:14 user sudo[80107]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4w30_g0_/privsep.sock
Jul 27 13:32:14 user sudo[80107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 13:32:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:15 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:32:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:32:15 user nova-compute[70914]: INFO nova.compute.claims [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Claim successful on node user
Jul 27 13:32:15 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:32:15 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:32:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:15 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:32:16 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:32:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:32:16 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Creating image(s)
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:16 user sudo[80107]: pam_unix(sudo:session): session closed for user root
Jul 27 13:32:16 user nova-compute[70914]: INFO oslo.privsep.daemon [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Spawned new privsep daemon via rootwrap
Jul 27 13:32:16 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 13:32:16 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 13:32:16 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 27 13:32:16 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80114
Jul 27 13:32:16 user nova-compute[70914]: WARNING oslo_privsep.priv_context [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] privsep daemon already running
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG nova.policy [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0d92b0b34814e75a7709e09e357be07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b177edc7249f798bca2c39a33394d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk 1073741824" returned: 0 in 0.049s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.199s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.162s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk 1073741824" returned: 0 in 0.049s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Cannot resize image /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'migration_context' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Ensure instance console log exists: /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.129s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Cannot resize image /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.objects.instance [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'migration_context' on Instance uuid e45fbfcb-0107-4410-b5e1-71ba56995748 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Ensure instance console log exists: /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Successfully created port: 15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:32:18 user nova-compute[70914]: INFO nova.compute.claims [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Claim successful on node user
Jul 27 13:32:18 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Successfully created port: c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:32:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:32:18 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:32:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG nova.policy [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33282a3585b84222b077b7e6e4743432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d1576a91244db4b06bdcdc6f9b4c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:32:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Creating image(s)
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "/opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "/opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.183s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.130s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk 1073741824" returned: 0 in 0.048s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:32:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:20 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Cannot resize image /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:32:20 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lazy-loading 'migration_context' on Instance uuid 4cebb814-61ed-43f8-a4ec-a15abdcd265e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:32:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Ensure instance console log exists: /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:32:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:22 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Successfully updated port: 15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:32:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquired lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:22 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:32:22 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:32:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-fc57e423-099d-439d-9ea6-8a71833dabe8 req-2860dcc5-ab80-4cd2-9c8e-58b176692205 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-changed-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-fc57e423-099d-439d-9ea6-8a71833dabe8 req-2860dcc5-ab80-4cd2-9c8e-58b176692205 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Refreshing instance network info cache due to event network-changed-15896fd3-c444-414b-81ae-8594251d3c8e. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:32:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fc57e423-099d-439d-9ea6-8a71833dabe8 req-2860dcc5-ab80-4cd2-9c8e-58b176692205 service nova] Acquiring lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:22 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Successfully created port: 5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:32:23 user nova-compute[70914]: INFO nova.compute.claims [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Claim successful on node user
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.network.neutron [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:32:23 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Successfully updated port: c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquired lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:32:23 user nova-compute[70914]: DEBUG nova.policy [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84825f59c7be48698b64b0f24ab85b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59369b8cbb148fc9d60ef1513579205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updating instance_info_cache with network_info: [{"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:32:24 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Creating image(s)
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "/opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "/opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "/opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Releasing lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Instance network_info: |[{"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fc57e423-099d-439d-9ea6-8a71833dabe8 req-2860dcc5-ab80-4cd2-9c8e-58b176692205 service nova] Acquired lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.network.neutron [req-fc57e423-099d-439d-9ea6-8a71833dabe8 req-2860dcc5-ab80-4cd2-9c8e-58b176692205 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Refreshing network info cache for port 15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Start _get_guest_xml network_info=[{"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:32:24 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:24 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1172859920',display_name='tempest-ServerRescueNegativeTestJSON-server-1172859920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1172859920',id=1,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-rf0p6iln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:13Z,user_data=None,user_id='a0d92b0b34814e75a7709e09e357be07',uuid=1b676522-c547-497a-9b3b-8436f85c7f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:0e:6b,bridge_name='br-int',has_traffic_filtering=True,id=15896fd3-c444-414b-81ae-8594251d3c8e,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15896fd3-c4') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.181s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:32:24 user nova-compute[70914]:   <uuid>1b676522-c547-497a-9b3b-8436f85c7f40</uuid>
Jul 27 13:32:24 user nova-compute[70914]:   <name>instance-00000001</name>
Jul 27 13:32:24 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:32:24 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:32:24 user nova-compute[70914]:   <metadata>
Jul 27 13:32:24 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:32:24 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:32:24 user nova-compute[70914]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1172859920</nova:name>
Jul 27 13:32:24 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:32:24</nova:creationTime>
Jul 27 13:32:24 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:32:24 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:32:24 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:32:24 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:32:24 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:32:24 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:32:24 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:32:24 user nova-compute[70914]:       <nova:owner>
Jul 27 13:32:24 user nova-compute[70914]:         <nova:user uuid="a0d92b0b34814e75a7709e09e357be07">tempest-ServerRescueNegativeTestJSON-1275773337-project-member</nova:user>
Jul 27 13:32:24 user nova-compute[70914]:         <nova:project uuid="097b177edc7249f798bca2c39a33394d">tempest-ServerRescueNegativeTestJSON-1275773337</nova:project>
Jul 27 13:32:24 user nova-compute[70914]:       </nova:owner>
Jul 27 13:32:24 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:32:24 user nova-compute[70914]:       <nova:ports>
Jul 27 13:32:24 user nova-compute[70914]:         <nova:port uuid="15896fd3-c444-414b-81ae-8594251d3c8e">
Jul 27 13:32:24 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:32:24 user nova-compute[70914]:         </nova:port>
Jul 27 13:32:24 user nova-compute[70914]:       </nova:ports>
Jul 27 13:32:24 user nova-compute[70914]:     </nova:instance>
Jul 27 13:32:24 user nova-compute[70914]:   </metadata>
Jul 27 13:32:24 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:32:24 user nova-compute[70914]:     <system>
Jul 27 13:32:24 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:32:24 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:32:24 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:32:24 user nova-compute[70914]:       <entry name="serial">1b676522-c547-497a-9b3b-8436f85c7f40</entry>
Jul 27 13:32:24 user nova-compute[70914]:       <entry name="uuid">1b676522-c547-497a-9b3b-8436f85c7f40</entry>
Jul 27 13:32:24 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:32:24 user nova-compute[70914]:     </system>
Jul 27 13:32:24 user nova-compute[70914]:   </sysinfo>
Jul 27 13:32:24 user nova-compute[70914]:   <os>
Jul 27 13:32:24 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:32:24 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:32:24 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:32:24 user nova-compute[70914]:   </os>
Jul 27 13:32:24 user nova-compute[70914]:   <features>
Jul 27 13:32:24 user nova-compute[70914]:     <acpi/>
Jul 27 13:32:24 user nova-compute[70914]:     <apic/>
Jul 27 13:32:24 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:32:24 user nova-compute[70914]:   </features>
Jul 27 13:32:24 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:32:24 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:32:24 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:32:24 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:32:24 user nova-compute[70914]:   </clock>
Jul 27 13:32:24 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:32:24 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:32:24 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:32:24 user nova-compute[70914]:   </cpu>
Jul 27 13:32:24 user nova-compute[70914]:   <devices>
Jul 27 13:32:24 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:32:24 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:32:24 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk"/>
Jul 27 13:32:24 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:32:24 user nova-compute[70914]:     </disk>
Jul 27 13:32:24 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:32:24 user nova-compute[70914]:       <mac address="fa:16:3e:73:0e:6b"/>
Jul 27 13:32:24 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:24 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:32:24 user nova-compute[70914]:       <target dev="tap15896fd3-c4"/>
Jul 27 13:32:24 user nova-compute[70914]:     </interface>
Jul 27 13:32:24 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:32:24 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/console.log" append="off"/>
Jul 27 13:32:24 user nova-compute[70914]:     </serial>
Jul 27 13:32:24 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:32:24 user nova-compute[70914]:     <video>
Jul 27 13:32:24 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:24 user nova-compute[70914]:     </video>
Jul 27 13:32:24 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:32:24 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:32:24 user nova-compute[70914]:     </rng>
Jul 27 13:32:24 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:32:24 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:32:24 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:32:24 user nova-compute[70914]:     </memballoon>
Jul 27 13:32:24 user nova-compute[70914]:   </devices>
Jul 27 13:32:24 user nova-compute[70914]: </domain>
Jul 27 13:32:24 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1172859920',display_name='tempest-ServerRescueNegativeTestJSON-server-1172859920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1172859920',id=1,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-rf0p6iln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:13Z,user_data=None,user_id='a0d92b0b34814e75a7709e09e357be07',uuid=1b676522-c547-497a-9b3b-8436f85c7f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:0e:6b,bridge_name='br-int',has_traffic_filtering=True,id=15896fd3-c444-414b-81ae-8594251d3c8e,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15896fd3-c4') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG os_vif [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:0e:6b,bridge_name='br-int',has_traffic_filtering=True,id=15896fd3-c444-414b-81ae-8594251d3c8e,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15896fd3-c4') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Created schema index Interface.name {{(pid=70914) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Created schema index Port.name {{(pid=70914) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Created schema index Bridge.name {{(pid=70914) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [POLLOUT] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.175s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk 1073741824" returned: 0 in 0.059s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:24 user nova-compute[70914]: INFO oslo.privsep.daemon [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmppjuynxqx/privsep.sock']
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:24 user sudo[80191]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmppjuynxqx/privsep.sock
Jul 27 13:32:24 user sudo[80191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.168s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Cannot resize image /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.objects.instance [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lazy-loading 'migration_context' on Instance uuid 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-25b38bf4-1283-4b48-9d38-2bc8da67f97f req-6e3d971b-90ff-43dc-bf29-34df4cc0560f service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-changed-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-25b38bf4-1283-4b48-9d38-2bc8da67f97f req-6e3d971b-90ff-43dc-bf29-34df4cc0560f service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Refreshing instance network info cache due to event network-changed-c29c2d71-8315-41b0-9029-d9cd7803d316. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-25b38bf4-1283-4b48-9d38-2bc8da67f97f req-6e3d971b-90ff-43dc-bf29-34df4cc0560f service nova] Acquiring lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Ensure instance console log exists: /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:32:25 user nova-compute[70914]: INFO nova.compute.claims [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Claim successful on node user
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updating instance_info_cache with network_info: [{"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Releasing lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Instance network_info: |[{"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-25b38bf4-1283-4b48-9d38-2bc8da67f97f req-6e3d971b-90ff-43dc-bf29-34df4cc0560f service nova] Acquired lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.network.neutron [req-25b38bf4-1283-4b48-9d38-2bc8da67f97f req-6e3d971b-90ff-43dc-bf29-34df4cc0560f service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Refreshing network info cache for port c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Start _get_guest_xml network_info=[{"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:32:25 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:25 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-851597049',display_name='tempest-ServerRescueNegativeTestJSON-server-851597049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-851597049',id=2,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-oj84tw8y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:16Z,user_data=None,user_id='a0d92b0b34814e75a7709e09e357be07',uuid=e45fbfcb-0107-4410-b5e1-71ba56995748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=c29c2d71-8315-41b0-9029-d9cd7803d316,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29c2d71-83') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.objects.instance [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'pci_devices' on Instance uuid e45fbfcb-0107-4410-b5e1-71ba56995748 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:32:25 user nova-compute[70914]:   <uuid>e45fbfcb-0107-4410-b5e1-71ba56995748</uuid>
Jul 27 13:32:25 user nova-compute[70914]:   <name>instance-00000002</name>
Jul 27 13:32:25 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:32:25 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:32:25 user nova-compute[70914]:   <metadata>
Jul 27 13:32:25 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:32:25 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:32:25 user nova-compute[70914]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-851597049</nova:name>
Jul 27 13:32:25 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:32:25</nova:creationTime>
Jul 27 13:32:25 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:32:25 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:32:25 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:32:25 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:32:25 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:32:25 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:32:25 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:32:25 user nova-compute[70914]:       <nova:owner>
Jul 27 13:32:25 user nova-compute[70914]:         <nova:user uuid="a0d92b0b34814e75a7709e09e357be07">tempest-ServerRescueNegativeTestJSON-1275773337-project-member</nova:user>
Jul 27 13:32:25 user nova-compute[70914]:         <nova:project uuid="097b177edc7249f798bca2c39a33394d">tempest-ServerRescueNegativeTestJSON-1275773337</nova:project>
Jul 27 13:32:25 user nova-compute[70914]:       </nova:owner>
Jul 27 13:32:25 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:32:25 user nova-compute[70914]:       <nova:ports>
Jul 27 13:32:25 user nova-compute[70914]:         <nova:port uuid="c29c2d71-8315-41b0-9029-d9cd7803d316">
Jul 27 13:32:25 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 13:32:25 user nova-compute[70914]:         </nova:port>
Jul 27 13:32:25 user nova-compute[70914]:       </nova:ports>
Jul 27 13:32:25 user nova-compute[70914]:     </nova:instance>
Jul 27 13:32:25 user nova-compute[70914]:   </metadata>
Jul 27 13:32:25 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:32:25 user nova-compute[70914]:     <system>
Jul 27 13:32:25 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:32:25 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:32:25 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:32:25 user nova-compute[70914]:       <entry name="serial">e45fbfcb-0107-4410-b5e1-71ba56995748</entry>
Jul 27 13:32:25 user nova-compute[70914]:       <entry name="uuid">e45fbfcb-0107-4410-b5e1-71ba56995748</entry>
Jul 27 13:32:25 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:32:25 user nova-compute[70914]:     </system>
Jul 27 13:32:25 user nova-compute[70914]:   </sysinfo>
Jul 27 13:32:25 user nova-compute[70914]:   <os>
Jul 27 13:32:25 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:32:25 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:32:25 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:32:25 user nova-compute[70914]:   </os>
Jul 27 13:32:25 user nova-compute[70914]:   <features>
Jul 27 13:32:25 user nova-compute[70914]:     <acpi/>
Jul 27 13:32:25 user nova-compute[70914]:     <apic/>
Jul 27 13:32:25 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:32:25 user nova-compute[70914]:   </features>
Jul 27 13:32:25 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:32:25 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:32:25 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:32:25 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:32:25 user nova-compute[70914]:   </clock>
Jul 27 13:32:25 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:32:25 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:32:25 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:32:25 user nova-compute[70914]:   </cpu>
Jul 27 13:32:25 user nova-compute[70914]:   <devices>
Jul 27 13:32:25 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:32:25 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:32:25 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk"/>
Jul 27 13:32:25 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:32:25 user nova-compute[70914]:     </disk>
Jul 27 13:32:25 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:32:25 user nova-compute[70914]:       <mac address="fa:16:3e:0c:c5:fe"/>
Jul 27 13:32:25 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:25 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:32:25 user nova-compute[70914]:       <target dev="tapc29c2d71-83"/>
Jul 27 13:32:25 user nova-compute[70914]:     </interface>
Jul 27 13:32:25 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:32:25 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/console.log" append="off"/>
Jul 27 13:32:25 user nova-compute[70914]:     </serial>
Jul 27 13:32:25 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:32:25 user nova-compute[70914]:     <video>
Jul 27 13:32:25 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:25 user nova-compute[70914]:     </video>
Jul 27 13:32:25 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:32:25 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:32:25 user nova-compute[70914]:     </rng>
Jul 27 13:32:25 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:32:25 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:32:25 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:32:25 user nova-compute[70914]:     </memballoon>
Jul 27 13:32:25 user nova-compute[70914]:   </devices>
Jul 27 13:32:25 user nova-compute[70914]: </domain>
Jul 27 13:32:25 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-851597049',display_name='tempest-ServerRescueNegativeTestJSON-server-851597049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-851597049',id=2,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-oj84tw8y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:16Z,user_data=None,user_id='a0d92b0b34814e75a7709e09e357be07',uuid=e45fbfcb-0107-4410-b5e1-71ba56995748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=c29c2d71-8315-41b0-9029-d9cd7803d316,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29c2d71-83') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG os_vif [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=c29c2d71-8315-41b0-9029-d9cd7803d316,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29c2d71-83') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.network.neutron [req-fc57e423-099d-439d-9ea6-8a71833dabe8 req-2860dcc5-ab80-4cd2-9c8e-58b176692205 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updated VIF entry in instance network info cache for port 15896fd3-c444-414b-81ae-8594251d3c8e. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.network.neutron [req-fc57e423-099d-439d-9ea6-8a71833dabe8 req-2860dcc5-ab80-4cd2-9c8e-58b176692205 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updating instance_info_cache with network_info: [{"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fc57e423-099d-439d-9ea6-8a71833dabe8 req-2860dcc5-ab80-4cd2-9c8e-58b176692205 service nova] Releasing lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:32:25 user nova-compute[70914]: INFO nova.compute.claims [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Claim successful on node user
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:32:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:32:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Creating image(s)
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "/opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "/opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "/opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Successfully updated port: 5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.policy [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe9d73d3e87c4ad4a1ff9afb4ee6a9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a180220b142349188245dd88298da020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "refresh_cache-4cebb814-61ed-43f8-a4ec-a15abdcd265e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquired lock "refresh_cache-4cebb814-61ed-43f8-a4ec-a15abdcd265e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.170s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:26 user sudo[80191]: pam_unix(sudo:session): session closed for user root
Jul 27 13:32:26 user nova-compute[70914]: INFO oslo.privsep.daemon [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Spawned new privsep daemon via rootwrap
Jul 27 13:32:26 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 13:32:26 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 13:32:26 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 27 13:32:26 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80200
Jul 27 13:32:26 user nova-compute[70914]: WARNING oslo_privsep.priv_context [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] privsep daemon already running
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.163s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk 1073741824" returned: 0 in 0.046s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:32:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.129s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Successfully created port: 07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-552c56d9-fba8-426b-be1d-ccffacc42cd1 req-cd25b167-8701-48ff-9e2f-fff552e3d425 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Received event network-changed-5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-552c56d9-fba8-426b-be1d-ccffacc42cd1 req-cd25b167-8701-48ff-9e2f-fff552e3d425 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Refreshing instance network info cache due to event network-changed-5d3e91a2-f550-459c-ba68-1188ce457d32. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-552c56d9-fba8-426b-be1d-ccffacc42cd1 req-cd25b167-8701-48ff-9e2f-fff552e3d425 service nova] Acquiring lock "refresh_cache-4cebb814-61ed-43f8-a4ec-a15abdcd265e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Cannot resize image /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'migration_context' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Ensure instance console log exists: /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.policy [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e9e3e0bd86140ada9edb906a16e4784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b9d12319d046088ca51fc23be9bb21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:32:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Creating image(s)
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "/opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "/opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc29c2d71-83, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc29c2d71-83, col_values=(('external_ids', {'iface-id': 'c29c2d71-8315-41b0-9029-d9cd7803d316', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:c5:fe', 'vm-uuid': 'e45fbfcb-0107-4410-b5e1-71ba56995748'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:27 user nova-compute[70914]: INFO os_vif [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=c29c2d71-8315-41b0-9029-d9cd7803d316,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29c2d71-83')
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15896fd3-c4, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15896fd3-c4, col_values=(('external_ids', {'iface-id': '15896fd3-c444-414b-81ae-8594251d3c8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:0e:6b', 'vm-uuid': '1b676522-c547-497a-9b3b-8436f85c7f40'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:27 user nova-compute[70914]: INFO os_vif [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:0e:6b,bridge_name='br-int',has_traffic_filtering=True,id=15896fd3-c444-414b-81ae-8594251d3c8e,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15896fd3-c4')
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.network.neutron [req-25b38bf4-1283-4b48-9d38-2bc8da67f97f req-6e3d971b-90ff-43dc-bf29-34df4cc0560f service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updated VIF entry in instance network info cache for port c29c2d71-8315-41b0-9029-d9cd7803d316. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.network.neutron [req-25b38bf4-1283-4b48-9d38-2bc8da67f97f req-6e3d971b-90ff-43dc-bf29-34df4cc0560f service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updating instance_info_cache with network_info: [{"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk 1073741824" returned: 0 in 0.063s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-25b38bf4-1283-4b48-9d38-2bc8da67f97f req-6e3d971b-90ff-43dc-bf29-34df4cc0560f service nova] Releasing lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No VIF found with MAC fa:16:3e:73:0e:6b, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No VIF found with MAC fa:16:3e:0c:c5:fe, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "d54b6163-cc14-44d4-91c6-d306168bb875" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "d54b6163-cc14-44d4-91c6-d306168bb875" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Updating instance_info_cache with network_info: [{"id": "5d3e91a2-f550-459c-ba68-1188ce457d32", "address": "fa:16:3e:53:ef:86", "network": {"id": "31a04dc2-c876-4f85-8c3f-66fcd7653845", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501842633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d1576a91244db4b06bdcdc6f9b4c53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3e91a2-f5", "ovs_interfaceid": "5d3e91a2-f550-459c-ba68-1188ce457d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Releasing lock "refresh_cache-4cebb814-61ed-43f8-a4ec-a15abdcd265e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Instance network_info: |[{"id": "5d3e91a2-f550-459c-ba68-1188ce457d32", "address": "fa:16:3e:53:ef:86", "network": {"id": "31a04dc2-c876-4f85-8c3f-66fcd7653845", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501842633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d1576a91244db4b06bdcdc6f9b4c53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3e91a2-f5", "ovs_interfaceid": "5d3e91a2-f550-459c-ba68-1188ce457d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-552c56d9-fba8-426b-be1d-ccffacc42cd1 req-cd25b167-8701-48ff-9e2f-fff552e3d425 service nova] Acquired lock "refresh_cache-4cebb814-61ed-43f8-a4ec-a15abdcd265e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.network.neutron [req-552c56d9-fba8-426b-be1d-ccffacc42cd1 req-cd25b167-8701-48ff-9e2f-fff552e3d425 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Refreshing network info cache for port 5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Start _get_guest_xml network_info=[{"id": "5d3e91a2-f550-459c-ba68-1188ce457d32", "address": "fa:16:3e:53:ef:86", "network": {"id": "31a04dc2-c876-4f85-8c3f-66fcd7653845", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501842633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d1576a91244db4b06bdcdc6f9b4c53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3e91a2-f5", "ovs_interfaceid": "5d3e91a2-f550-459c-ba68-1188ce457d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Cannot resize image /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.objects.instance [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'migration_context' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Ensure instance console log exists: /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:27 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:27 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1379731878',display_name='tempest-DeleteServersTestJSON-server-1379731878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1379731878',id=3,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41d1576a91244db4b06bdcdc6f9b4c53',ramdisk_id='',reservation_id='r-nuog0a3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1454261370',owner_user_name='tempest-DeleteServersTestJSON-1454261370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:19Z,user_data=None,user_id='33282a3585b84222b077b7e6e4743432',uuid=4cebb814-61ed-43f8-a4ec-a15abdcd265e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d3e91a2-f550-459c-ba68-1188ce457d32", "address": "fa:16:3e:53:ef:86", "network": {"id": "31a04dc2-c876-4f85-8c3f-66fcd7653845", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501842633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d1576a91244db4b06bdcdc6f9b4c53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3e91a2-f5", "ovs_interfaceid": "5d3e91a2-f550-459c-ba68-1188ce457d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Converting VIF {"id": "5d3e91a2-f550-459c-ba68-1188ce457d32", "address": "fa:16:3e:53:ef:86", "network": {"id": "31a04dc2-c876-4f85-8c3f-66fcd7653845", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501842633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d1576a91244db4b06bdcdc6f9b4c53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3e91a2-f5", "ovs_interfaceid": "5d3e91a2-f550-459c-ba68-1188ce457d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=5d3e91a2-f550-459c-ba68-1188ce457d32,network=Network(31a04dc2-c876-4f85-8c3f-66fcd7653845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3e91a2-f5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cebb814-61ed-43f8-a4ec-a15abdcd265e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:32:27 user nova-compute[70914]: INFO nova.compute.claims [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Claim successful on node user
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:32:27 user nova-compute[70914]:   <uuid>4cebb814-61ed-43f8-a4ec-a15abdcd265e</uuid>
Jul 27 13:32:27 user nova-compute[70914]:   <name>instance-00000003</name>
Jul 27 13:32:27 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:32:27 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:32:27 user nova-compute[70914]:   <metadata>
Jul 27 13:32:27 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:32:27 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:32:27 user nova-compute[70914]:       <nova:name>tempest-DeleteServersTestJSON-server-1379731878</nova:name>
Jul 27 13:32:27 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:32:27</nova:creationTime>
Jul 27 13:32:27 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:32:27 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:32:27 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:32:27 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:32:27 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:32:27 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:32:27 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:32:27 user nova-compute[70914]:       <nova:owner>
Jul 27 13:32:27 user nova-compute[70914]:         <nova:user uuid="33282a3585b84222b077b7e6e4743432">tempest-DeleteServersTestJSON-1454261370-project-member</nova:user>
Jul 27 13:32:27 user nova-compute[70914]:         <nova:project uuid="41d1576a91244db4b06bdcdc6f9b4c53">tempest-DeleteServersTestJSON-1454261370</nova:project>
Jul 27 13:32:27 user nova-compute[70914]:       </nova:owner>
Jul 27 13:32:27 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:32:27 user nova-compute[70914]:       <nova:ports>
Jul 27 13:32:27 user nova-compute[70914]:         <nova:port uuid="5d3e91a2-f550-459c-ba68-1188ce457d32">
Jul 27 13:32:27 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 13:32:27 user nova-compute[70914]:         </nova:port>
Jul 27 13:32:27 user nova-compute[70914]:       </nova:ports>
Jul 27 13:32:27 user nova-compute[70914]:     </nova:instance>
Jul 27 13:32:27 user nova-compute[70914]:   </metadata>
Jul 27 13:32:27 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:32:27 user nova-compute[70914]:     <system>
Jul 27 13:32:27 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:32:27 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:32:27 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:32:27 user nova-compute[70914]:       <entry name="serial">4cebb814-61ed-43f8-a4ec-a15abdcd265e</entry>
Jul 27 13:32:27 user nova-compute[70914]:       <entry name="uuid">4cebb814-61ed-43f8-a4ec-a15abdcd265e</entry>
Jul 27 13:32:27 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:32:27 user nova-compute[70914]:     </system>
Jul 27 13:32:27 user nova-compute[70914]:   </sysinfo>
Jul 27 13:32:27 user nova-compute[70914]:   <os>
Jul 27 13:32:27 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:32:27 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:32:27 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:32:27 user nova-compute[70914]:   </os>
Jul 27 13:32:27 user nova-compute[70914]:   <features>
Jul 27 13:32:27 user nova-compute[70914]:     <acpi/>
Jul 27 13:32:27 user nova-compute[70914]:     <apic/>
Jul 27 13:32:27 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:32:27 user nova-compute[70914]:   </features>
Jul 27 13:32:27 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:32:27 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:32:27 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:32:27 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:32:27 user nova-compute[70914]:   </clock>
Jul 27 13:32:27 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:32:27 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:32:27 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:32:27 user nova-compute[70914]:   </cpu>
Jul 27 13:32:27 user nova-compute[70914]:   <devices>
Jul 27 13:32:27 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:32:27 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:32:27 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk"/>
Jul 27 13:32:27 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:32:27 user nova-compute[70914]:     </disk>
Jul 27 13:32:27 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:32:27 user nova-compute[70914]:       <mac address="fa:16:3e:53:ef:86"/>
Jul 27 13:32:27 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:27 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:32:27 user nova-compute[70914]:       <target dev="tap5d3e91a2-f5"/>
Jul 27 13:32:27 user nova-compute[70914]:     </interface>
Jul 27 13:32:27 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:32:27 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/console.log" append="off"/>
Jul 27 13:32:27 user nova-compute[70914]:     </serial>
Jul 27 13:32:27 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:32:27 user nova-compute[70914]:     <video>
Jul 27 13:32:27 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:27 user nova-compute[70914]:     </video>
Jul 27 13:32:27 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:32:27 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:32:27 user nova-compute[70914]:     </rng>
Jul 27 13:32:27 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:32:27 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:32:27 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:32:27 user nova-compute[70914]:     </memballoon>
Jul 27 13:32:27 user nova-compute[70914]:   </devices>
Jul 27 13:32:27 user nova-compute[70914]: </domain>
Jul 27 13:32:27 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1379731878',display_name='tempest-DeleteServersTestJSON-server-1379731878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1379731878',id=3,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41d1576a91244db4b06bdcdc6f9b4c53',ramdisk_id='',reservation_id='r-nuog0a3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1454261370',owner_user_name='tempest-DeleteServersTestJSON-1454261370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:19Z,user_data=None,user_id='33282a3585b84222b077b7e6e4743432',uuid=4cebb814-61ed-43f8-a4ec-a15abdcd265e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d3e91a2-f550-459c-ba68-1188ce457d32", "address": "fa:16:3e:53:ef:86", "network": {"id": "31a04dc2-c876-4f85-8c3f-66fcd7653845", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501842633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d1576a91244db4b06bdcdc6f9b4c53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3e91a2-f5", "ovs_interfaceid": "5d3e91a2-f550-459c-ba68-1188ce457d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Converting VIF {"id": "5d3e91a2-f550-459c-ba68-1188ce457d32", "address": "fa:16:3e:53:ef:86", "network": {"id": "31a04dc2-c876-4f85-8c3f-66fcd7653845", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501842633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d1576a91244db4b06bdcdc6f9b4c53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3e91a2-f5", "ovs_interfaceid": "5d3e91a2-f550-459c-ba68-1188ce457d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=5d3e91a2-f550-459c-ba68-1188ce457d32,network=Network(31a04dc2-c876-4f85-8c3f-66fcd7653845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3e91a2-f5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG os_vif [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=5d3e91a2-f550-459c-ba68-1188ce457d32,network=Network(31a04dc2-c876-4f85-8c3f-66fcd7653845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3e91a2-f5') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d3e91a2-f5, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d3e91a2-f5, col_values=(('external_ids', {'iface-id': '5d3e91a2-f550-459c-ba68-1188ce457d32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:ef:86', 'vm-uuid': '4cebb814-61ed-43f8-a4ec-a15abdcd265e'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:27 user nova-compute[70914]: INFO os_vif [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=5d3e91a2-f550-459c-ba68-1188ce457d32,network=Network(31a04dc2-c876-4f85-8c3f-66fcd7653845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3e91a2-f5')
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:32:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] No VIF found with MAC fa:16:3e:53:ef:86, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:32:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:32:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Creating image(s)
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "/opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "/opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "/opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] There are 0 instances to clean {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.network.neutron [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Successfully created port: ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances with incomplete migration  {{(pid=70914) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.policy [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9279e1abc6946bc970fa3b2b2119c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c94597dacc420abba408e3b60f4a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.186s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Successfully created port: 3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.130s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk 1073741824" returned: 0 in 0.048s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.158s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG nova.network.neutron [req-552c56d9-fba8-426b-be1d-ccffacc42cd1 req-cd25b167-8701-48ff-9e2f-fff552e3d425 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Updated VIF entry in instance network info cache for port 5d3e91a2-f550-459c-ba68-1188ce457d32. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG nova.network.neutron [req-552c56d9-fba8-426b-be1d-ccffacc42cd1 req-cd25b167-8701-48ff-9e2f-fff552e3d425 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Updating instance_info_cache with network_info: [{"id": "5d3e91a2-f550-459c-ba68-1188ce457d32", "address": "fa:16:3e:53:ef:86", "network": {"id": "31a04dc2-c876-4f85-8c3f-66fcd7653845", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501842633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d1576a91244db4b06bdcdc6f9b4c53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3e91a2-f5", "ovs_interfaceid": "5d3e91a2-f550-459c-ba68-1188ce457d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-552c56d9-fba8-426b-be1d-ccffacc42cd1 req-cd25b167-8701-48ff-9e2f-fff552e3d425 service nova] Releasing lock "refresh_cache-4cebb814-61ed-43f8-a4ec-a15abdcd265e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Cannot resize image /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG nova.objects.instance [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'migration_context' on Instance uuid d54b6163-cc14-44d4-91c6-d306168bb875 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Ensure instance console log exists: /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG nova.network.neutron [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Successfully updated port: 07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquired lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:29 user nova-compute[70914]: DEBUG nova.network.neutron [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG nova.network.neutron [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-7b9b2e4d-969c-4144-abc9-9526a88efdc6 req-96007cab-2893-4bdf-b8dc-343ec5bb1494 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Received event network-changed-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-7b9b2e4d-969c-4144-abc9-9526a88efdc6 req-96007cab-2893-4bdf-b8dc-343ec5bb1494 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Refreshing instance network info cache due to event network-changed-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7b9b2e4d-969c-4144-abc9-9526a88efdc6 req-96007cab-2893-4bdf-b8dc-343ec5bb1494 service nova] Acquiring lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Successfully updated port: 3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquired lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-91731053-30b6-4822-9485-d6b5caad1b72 req-e9935092-0de3-42c9-8c30-c01095e07671 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-changed-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-91731053-30b6-4822-9485-d6b5caad1b72 req-e9935092-0de3-42c9-8c30-c01095e07671 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Refreshing instance network info cache due to event network-changed-3e9e022a-7a8b-42ed-b88f-2c32b880ee78. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-91731053-30b6-4822-9485-d6b5caad1b72 req-e9935092-0de3-42c9-8c30-c01095e07671 service nova] Acquiring lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.neutron [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Updating instance_info_cache with network_info: [{"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Releasing lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Instance network_info: |[{"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7b9b2e4d-969c-4144-abc9-9526a88efdc6 req-96007cab-2893-4bdf-b8dc-343ec5bb1494 service nova] Acquired lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.neutron [req-7b9b2e4d-969c-4144-abc9-9526a88efdc6 req-96007cab-2893-4bdf-b8dc-343ec5bb1494 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Refreshing network info cache for port 07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Start _get_guest_xml network_info=[{"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:32:31 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:31 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-298963430',display_name='tempest-ServersNegativeTestJSON-server-298963430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-298963430',id=4,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e59369b8cbb148fc9d60ef1513579205',ramdisk_id='',reservation_id='r-960x84r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1243391903',owner_user_name='tempest-ServersNegativeTestJSON-1243391903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:24Z,user_data=None,user_id='84825f59c7be48698b64b0f24ab85b1e',uuid=60c81594-3bfb-4c2c-ad6a-b9418f5c7651,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converting VIF {"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:96:50,bridge_name='br-int',has_traffic_filtering=True,id=07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a7bc1b-e5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lazy-loading 'pci_devices' on Instance uuid 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:32:31 user nova-compute[70914]:   <uuid>60c81594-3bfb-4c2c-ad6a-b9418f5c7651</uuid>
Jul 27 13:32:31 user nova-compute[70914]:   <name>instance-00000004</name>
Jul 27 13:32:31 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:32:31 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:32:31 user nova-compute[70914]:   <metadata>
Jul 27 13:32:31 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:32:31 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:32:31 user nova-compute[70914]:       <nova:name>tempest-ServersNegativeTestJSON-server-298963430</nova:name>
Jul 27 13:32:31 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:32:31</nova:creationTime>
Jul 27 13:32:31 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:32:31 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:32:31 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:32:31 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:32:31 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:32:31 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:32:31 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:32:31 user nova-compute[70914]:       <nova:owner>
Jul 27 13:32:31 user nova-compute[70914]:         <nova:user uuid="84825f59c7be48698b64b0f24ab85b1e">tempest-ServersNegativeTestJSON-1243391903-project-member</nova:user>
Jul 27 13:32:31 user nova-compute[70914]:         <nova:project uuid="e59369b8cbb148fc9d60ef1513579205">tempest-ServersNegativeTestJSON-1243391903</nova:project>
Jul 27 13:32:31 user nova-compute[70914]:       </nova:owner>
Jul 27 13:32:31 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:32:31 user nova-compute[70914]:       <nova:ports>
Jul 27 13:32:31 user nova-compute[70914]:         <nova:port uuid="07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a">
Jul 27 13:32:31 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 13:32:31 user nova-compute[70914]:         </nova:port>
Jul 27 13:32:31 user nova-compute[70914]:       </nova:ports>
Jul 27 13:32:31 user nova-compute[70914]:     </nova:instance>
Jul 27 13:32:31 user nova-compute[70914]:   </metadata>
Jul 27 13:32:31 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:32:31 user nova-compute[70914]:     <system>
Jul 27 13:32:31 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:32:31 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:32:31 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:32:31 user nova-compute[70914]:       <entry name="serial">60c81594-3bfb-4c2c-ad6a-b9418f5c7651</entry>
Jul 27 13:32:31 user nova-compute[70914]:       <entry name="uuid">60c81594-3bfb-4c2c-ad6a-b9418f5c7651</entry>
Jul 27 13:32:31 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:32:31 user nova-compute[70914]:     </system>
Jul 27 13:32:31 user nova-compute[70914]:   </sysinfo>
Jul 27 13:32:31 user nova-compute[70914]:   <os>
Jul 27 13:32:31 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:32:31 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:32:31 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:32:31 user nova-compute[70914]:   </os>
Jul 27 13:32:31 user nova-compute[70914]:   <features>
Jul 27 13:32:31 user nova-compute[70914]:     <acpi/>
Jul 27 13:32:31 user nova-compute[70914]:     <apic/>
Jul 27 13:32:31 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:32:31 user nova-compute[70914]:   </features>
Jul 27 13:32:31 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:32:31 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:32:31 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:32:31 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:32:31 user nova-compute[70914]:   </clock>
Jul 27 13:32:31 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:32:31 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:32:31 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:32:31 user nova-compute[70914]:   </cpu>
Jul 27 13:32:31 user nova-compute[70914]:   <devices>
Jul 27 13:32:31 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:32:31 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:32:31 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk"/>
Jul 27 13:32:31 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:32:31 user nova-compute[70914]:     </disk>
Jul 27 13:32:31 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:32:31 user nova-compute[70914]:       <mac address="fa:16:3e:90:96:50"/>
Jul 27 13:32:31 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:31 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:32:31 user nova-compute[70914]:       <target dev="tap07a7bc1b-e5"/>
Jul 27 13:32:31 user nova-compute[70914]:     </interface>
Jul 27 13:32:31 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:32:31 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/console.log" append="off"/>
Jul 27 13:32:31 user nova-compute[70914]:     </serial>
Jul 27 13:32:31 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:32:31 user nova-compute[70914]:     <video>
Jul 27 13:32:31 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:31 user nova-compute[70914]:     </video>
Jul 27 13:32:31 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:32:31 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:32:31 user nova-compute[70914]:     </rng>
Jul 27 13:32:31 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:32:31 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:32:31 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:32:31 user nova-compute[70914]:     </memballoon>
Jul 27 13:32:31 user nova-compute[70914]:   </devices>
Jul 27 13:32:31 user nova-compute[70914]: </domain>
Jul 27 13:32:31 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-298963430',display_name='tempest-ServersNegativeTestJSON-server-298963430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-298963430',id=4,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e59369b8cbb148fc9d60ef1513579205',ramdisk_id='',reservation_id='r-960x84r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1243391903',owner_user_name='tempest-ServersNegativeTestJSON-1243391903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:24Z,user_data=None,user_id='84825f59c7be48698b64b0f24ab85b1e',uuid=60c81594-3bfb-4c2c-ad6a-b9418f5c7651,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converting VIF {"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:96:50,bridge_name='br-int',has_traffic_filtering=True,id=07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a7bc1b-e5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG os_vif [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:96:50,bridge_name='br-int',has_traffic_filtering=True,id=07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a7bc1b-e5') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07a7bc1b-e5, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07a7bc1b-e5, col_values=(('external_ids', {'iface-id': '07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:96:50', 'vm-uuid': '60c81594-3bfb-4c2c-ad6a-b9418f5c7651'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: INFO os_vif [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:96:50,bridge_name='br-int',has_traffic_filtering=True,id=07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a7bc1b-e5')
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] No VIF found with MAC fa:16:3e:90:96:50, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Successfully created port: fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.neutron [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Successfully updated port: ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquired lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.neutron [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-d9cf342d-67e6-4655-8e72-5268be35c5bb req-02cb9b2f-dad2-491e-b2af-081b673f133f service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-changed-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-d9cf342d-67e6-4655-8e72-5268be35c5bb req-02cb9b2f-dad2-491e-b2af-081b673f133f service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Refreshing instance network info cache due to event network-changed-ae2390d8-702c-478a-8f63-ff3c36403dc3. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d9cf342d-67e6-4655-8e72-5268be35c5bb req-02cb9b2f-dad2-491e-b2af-081b673f133f service nova] Acquiring lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updating instance_info_cache with network_info: [{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Releasing lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance network_info: |[{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-91731053-30b6-4822-9485-d6b5caad1b72 req-e9935092-0de3-42c9-8c30-c01095e07671 service nova] Acquired lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.network.neutron [req-91731053-30b6-4822-9485-d6b5caad1b72 req-e9935092-0de3-42c9-8c30-c01095e07671 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Refreshing network info cache for port 3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:32:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Start _get_guest_xml network_info=[{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:32:32 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:32 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1253144734',display_name='tempest-AttachVolumeTestJSON-server-1253144734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1253144734',id=6,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATTI1RFyfQ2PRv5NB5cEM2tkF6yPM7cRAOJeCVPdJukiYvV0GqTPHVKc2LLrkmUe7gAf9AX0WCEnPmbS46UKi6r5ob0VnyeUfGZfj+EtT1Nf6CADr6H3u6d7f2/M6ZW3A==',key_name='tempest-keypair-1952109515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-k0nq37r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.objects.instance [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'pci_devices' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:32:32 user nova-compute[70914]:   <uuid>bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5</uuid>
Jul 27 13:32:32 user nova-compute[70914]:   <name>instance-00000006</name>
Jul 27 13:32:32 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:32:32 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:32:32 user nova-compute[70914]:   <metadata>
Jul 27 13:32:32 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:32:32 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:32:32 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeTestJSON-server-1253144734</nova:name>
Jul 27 13:32:32 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:32:32</nova:creationTime>
Jul 27 13:32:32 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:32:32 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:32:32 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:32:32 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:32:32 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:32:32 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:32:32 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:32:32 user nova-compute[70914]:       <nova:owner>
Jul 27 13:32:32 user nova-compute[70914]:         <nova:user uuid="7e9e3e0bd86140ada9edb906a16e4784">tempest-AttachVolumeTestJSON-366868791-project-member</nova:user>
Jul 27 13:32:32 user nova-compute[70914]:         <nova:project uuid="b0b9d12319d046088ca51fc23be9bb21">tempest-AttachVolumeTestJSON-366868791</nova:project>
Jul 27 13:32:32 user nova-compute[70914]:       </nova:owner>
Jul 27 13:32:32 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:32:32 user nova-compute[70914]:       <nova:ports>
Jul 27 13:32:32 user nova-compute[70914]:         <nova:port uuid="3e9e022a-7a8b-42ed-b88f-2c32b880ee78">
Jul 27 13:32:32 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 13:32:32 user nova-compute[70914]:         </nova:port>
Jul 27 13:32:32 user nova-compute[70914]:       </nova:ports>
Jul 27 13:32:32 user nova-compute[70914]:     </nova:instance>
Jul 27 13:32:32 user nova-compute[70914]:   </metadata>
Jul 27 13:32:32 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:32:32 user nova-compute[70914]:     <system>
Jul 27 13:32:32 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:32:32 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:32:32 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:32:32 user nova-compute[70914]:       <entry name="serial">bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5</entry>
Jul 27 13:32:32 user nova-compute[70914]:       <entry name="uuid">bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5</entry>
Jul 27 13:32:32 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:32:32 user nova-compute[70914]:     </system>
Jul 27 13:32:32 user nova-compute[70914]:   </sysinfo>
Jul 27 13:32:32 user nova-compute[70914]:   <os>
Jul 27 13:32:32 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:32:32 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:32:32 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:32:32 user nova-compute[70914]:   </os>
Jul 27 13:32:32 user nova-compute[70914]:   <features>
Jul 27 13:32:32 user nova-compute[70914]:     <acpi/>
Jul 27 13:32:32 user nova-compute[70914]:     <apic/>
Jul 27 13:32:32 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:32:32 user nova-compute[70914]:   </features>
Jul 27 13:32:32 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:32:32 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:32:32 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:32:32 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:32:32 user nova-compute[70914]:   </clock>
Jul 27 13:32:32 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:32:32 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:32:32 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:32:32 user nova-compute[70914]:   </cpu>
Jul 27 13:32:32 user nova-compute[70914]:   <devices>
Jul 27 13:32:32 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:32:32 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:32:32 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk"/>
Jul 27 13:32:32 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:32:32 user nova-compute[70914]:     </disk>
Jul 27 13:32:32 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:32:32 user nova-compute[70914]:       <mac address="fa:16:3e:a7:0c:e4"/>
Jul 27 13:32:32 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:32 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:32:32 user nova-compute[70914]:       <target dev="tap3e9e022a-7a"/>
Jul 27 13:32:32 user nova-compute[70914]:     </interface>
Jul 27 13:32:32 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:32:32 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/console.log" append="off"/>
Jul 27 13:32:32 user nova-compute[70914]:     </serial>
Jul 27 13:32:32 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:32:32 user nova-compute[70914]:     <video>
Jul 27 13:32:32 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:32 user nova-compute[70914]:     </video>
Jul 27 13:32:32 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:32:32 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:32:32 user nova-compute[70914]:     </rng>
Jul 27 13:32:32 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:32:32 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:32:32 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:32:32 user nova-compute[70914]:     </memballoon>
Jul 27 13:32:32 user nova-compute[70914]:   </devices>
Jul 27 13:32:32 user nova-compute[70914]: </domain>
Jul 27 13:32:32 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1253144734',display_name='tempest-AttachVolumeTestJSON-server-1253144734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1253144734',id=6,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATTI1RFyfQ2PRv5NB5cEM2tkF6yPM7cRAOJeCVPdJukiYvV0GqTPHVKc2LLrkmUe7gAf9AX0WCEnPmbS46UKi6r5ob0VnyeUfGZfj+EtT1Nf6CADr6H3u6d7f2/M6ZW3A==',key_name='tempest-keypair-1952109515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-k0nq37r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG os_vif [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e9e022a-7a, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e9e022a-7a, col_values=(('external_ids', {'iface-id': '3e9e022a-7a8b-42ed-b88f-2c32b880ee78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:0c:e4', 'vm-uuid': 'bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:32 user nova-compute[70914]: INFO os_vif [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a')
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No VIF found with MAC fa:16:3e:a7:0c:e4, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-7b9b2e4d-969c-4144-abc9-9526a88efdc6 req-96007cab-2893-4bdf-b8dc-343ec5bb1494 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Updated VIF entry in instance network info cache for port 07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-7b9b2e4d-969c-4144-abc9-9526a88efdc6 req-96007cab-2893-4bdf-b8dc-343ec5bb1494 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Updating instance_info_cache with network_info: [{"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7b9b2e4d-969c-4144-abc9-9526a88efdc6 req-96007cab-2893-4bdf-b8dc-343ec5bb1494 service nova] Releasing lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:32 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG nova.network.neutron [req-91731053-30b6-4822-9485-d6b5caad1b72 req-e9935092-0de3-42c9-8c30-c01095e07671 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updated VIF entry in instance network info cache for port 3e9e022a-7a8b-42ed-b88f-2c32b880ee78. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG nova.network.neutron [req-91731053-30b6-4822-9485-d6b5caad1b72 req-e9935092-0de3-42c9-8c30-c01095e07671 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updating instance_info_cache with network_info: [{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-91731053-30b6-4822-9485-d6b5caad1b72 req-e9935092-0de3-42c9-8c30-c01095e07671 service nova] Releasing lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating instance_info_cache with network_info: [{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Releasing lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance network_info: |[{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d9cf342d-67e6-4655-8e72-5268be35c5bb req-02cb9b2f-dad2-491e-b2af-081b673f133f service nova] Acquired lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG nova.network.neutron [req-d9cf342d-67e6-4655-8e72-5268be35c5bb req-02cb9b2f-dad2-491e-b2af-081b673f133f service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Refreshing network info cache for port ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:32:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Start _get_guest_xml network_info=[{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:34 user nova-compute[70914]: WARNING nova.compute.manager [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state building and task_state spawning.
Jul 27 13:32:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:34 user nova-compute[70914]: WARNING nova.compute.manager [req-df40750a-bbed-4e8e-bf6b-c9252ef5eb3e req-cdcbbe2f-189b-4fa7-9ec2-f97ded265a49 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state building and task_state spawning.
Jul 27 13:32:34 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Successfully updated port: fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquired lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:34 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG nova.network.neutron [req-d9cf342d-67e6-4655-8e72-5268be35c5bb req-02cb9b2f-dad2-491e-b2af-081b673f133f service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updated VIF entry in instance network info cache for port ae2390d8-702c-478a-8f63-ff3c36403dc3. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG nova.network.neutron [req-d9cf342d-67e6-4655-8e72-5268be35c5bb req-02cb9b2f-dad2-491e-b2af-081b673f133f service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating instance_info_cache with network_info: [{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d9cf342d-67e6-4655-8e72-5268be35c5bb req-02cb9b2f-dad2-491e-b2af-081b673f133f service nova] Releasing lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-99321cbf-76e5-49c0-ba88-313eadbe2cc8 req-376ca892-8903-48a3-8d34-4428676bc9b6 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Received event network-vif-plugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-99321cbf-76e5-49c0-ba88-313eadbe2cc8 req-376ca892-8903-48a3-8d34-4428676bc9b6 service nova] Acquiring lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-99321cbf-76e5-49c0-ba88-313eadbe2cc8 req-376ca892-8903-48a3-8d34-4428676bc9b6 service nova] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-99321cbf-76e5-49c0-ba88-313eadbe2cc8 req-376ca892-8903-48a3-8d34-4428676bc9b6 service nova] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-99321cbf-76e5-49c0-ba88-313eadbe2cc8 req-376ca892-8903-48a3-8d34-4428676bc9b6 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] No waiting events found dispatching network-vif-plugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:36 user nova-compute[70914]: WARNING nova.compute.manager [req-99321cbf-76e5-49c0-ba88-313eadbe2cc8 req-376ca892-8903-48a3-8d34-4428676bc9b6 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Received unexpected event network-vif-plugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a for instance with vm_state building and task_state spawning.
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Received event network-vif-plugged-5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] Acquiring lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] No waiting events found dispatching network-vif-plugged-5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:36 user nova-compute[70914]: WARNING nova.compute.manager [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Received unexpected event network-vif-plugged-5d3e91a2-f550-459c-ba68-1188ce457d32 for instance with vm_state building and task_state spawning.
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received event network-changed-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Refreshing instance network info cache due to event network-changed-fc055a55-b554-442d-916b-59d5fbcd9868. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] Acquiring lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464756.3020074, 4cebb814-61ed-43f8-a4ec-a15abdcd265e => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] VM Resumed (Lifecycle Event)
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:32:36 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Instance spawned successfully.
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:32:36 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:36 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1925007786',display_name='tempest-ServerActionsTestOtherB-server-1925007786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1925007786',id=5,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHExeREDDPpeeto4dRdX/RKJZ83dPJH4sXgXTDLxmQ+8ZlOJR2MBG7t/gorV67US4l275/41OOOBwoDR8FgADW9jHIAHwwSPLUWO/b4tEzLREH2uqa5IWe2ftSKsaPh2Hw==',key_name='tempest-keypair-168588775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a180220b142349188245dd88298da020',ramdisk_id='',reservation_id='r-so1tb3rb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-874236545',owner_user_name='tempest-ServerActionsTestOtherB-874236545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe9d73d3e87c4ad4a1ff9afb4ee6a9b0',uuid=38108984-8bd8-49b6-9111-33c084a5a16a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converting VIF {"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.objects.instance [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'pci_devices' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:32:36 user nova-compute[70914]:   <uuid>38108984-8bd8-49b6-9111-33c084a5a16a</uuid>
Jul 27 13:32:36 user nova-compute[70914]:   <name>instance-00000005</name>
Jul 27 13:32:36 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:32:36 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:32:36 user nova-compute[70914]:   <metadata>
Jul 27 13:32:36 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:32:36 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:32:36 user nova-compute[70914]:       <nova:name>tempest-ServerActionsTestOtherB-server-1925007786</nova:name>
Jul 27 13:32:36 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:32:36</nova:creationTime>
Jul 27 13:32:36 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:32:36 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:32:36 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:32:36 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:32:36 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:32:36 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:32:36 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:32:36 user nova-compute[70914]:       <nova:owner>
Jul 27 13:32:36 user nova-compute[70914]:         <nova:user uuid="fe9d73d3e87c4ad4a1ff9afb4ee6a9b0">tempest-ServerActionsTestOtherB-874236545-project-member</nova:user>
Jul 27 13:32:36 user nova-compute[70914]:         <nova:project uuid="a180220b142349188245dd88298da020">tempest-ServerActionsTestOtherB-874236545</nova:project>
Jul 27 13:32:36 user nova-compute[70914]:       </nova:owner>
Jul 27 13:32:36 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:32:36 user nova-compute[70914]:       <nova:ports>
Jul 27 13:32:36 user nova-compute[70914]:         <nova:port uuid="ae2390d8-702c-478a-8f63-ff3c36403dc3">
Jul 27 13:32:36 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 13:32:36 user nova-compute[70914]:         </nova:port>
Jul 27 13:32:36 user nova-compute[70914]:       </nova:ports>
Jul 27 13:32:36 user nova-compute[70914]:     </nova:instance>
Jul 27 13:32:36 user nova-compute[70914]:   </metadata>
Jul 27 13:32:36 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:32:36 user nova-compute[70914]:     <system>
Jul 27 13:32:36 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:32:36 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:32:36 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:32:36 user nova-compute[70914]:       <entry name="serial">38108984-8bd8-49b6-9111-33c084a5a16a</entry>
Jul 27 13:32:36 user nova-compute[70914]:       <entry name="uuid">38108984-8bd8-49b6-9111-33c084a5a16a</entry>
Jul 27 13:32:36 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:32:36 user nova-compute[70914]:     </system>
Jul 27 13:32:36 user nova-compute[70914]:   </sysinfo>
Jul 27 13:32:36 user nova-compute[70914]:   <os>
Jul 27 13:32:36 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:32:36 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:32:36 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:32:36 user nova-compute[70914]:   </os>
Jul 27 13:32:36 user nova-compute[70914]:   <features>
Jul 27 13:32:36 user nova-compute[70914]:     <acpi/>
Jul 27 13:32:36 user nova-compute[70914]:     <apic/>
Jul 27 13:32:36 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:32:36 user nova-compute[70914]:   </features>
Jul 27 13:32:36 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:32:36 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:32:36 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:32:36 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:32:36 user nova-compute[70914]:   </clock>
Jul 27 13:32:36 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:32:36 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:32:36 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:32:36 user nova-compute[70914]:   </cpu>
Jul 27 13:32:36 user nova-compute[70914]:   <devices>
Jul 27 13:32:36 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:32:36 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:32:36 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk"/>
Jul 27 13:32:36 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:32:36 user nova-compute[70914]:     </disk>
Jul 27 13:32:36 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:32:36 user nova-compute[70914]:       <mac address="fa:16:3e:5c:af:6f"/>
Jul 27 13:32:36 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:36 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:32:36 user nova-compute[70914]:       <target dev="tapae2390d8-70"/>
Jul 27 13:32:36 user nova-compute[70914]:     </interface>
Jul 27 13:32:36 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:32:36 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/console.log" append="off"/>
Jul 27 13:32:36 user nova-compute[70914]:     </serial>
Jul 27 13:32:36 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:32:36 user nova-compute[70914]:     <video>
Jul 27 13:32:36 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:36 user nova-compute[70914]:     </video>
Jul 27 13:32:36 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:32:36 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:32:36 user nova-compute[70914]:     </rng>
Jul 27 13:32:36 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:32:36 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:32:36 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:32:36 user nova-compute[70914]:     </memballoon>
Jul 27 13:32:36 user nova-compute[70914]:   </devices>
Jul 27 13:32:36 user nova-compute[70914]: </domain>
Jul 27 13:32:36 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1925007786',display_name='tempest-ServerActionsTestOtherB-server-1925007786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1925007786',id=5,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHExeREDDPpeeto4dRdX/RKJZ83dPJH4sXgXTDLxmQ+8ZlOJR2MBG7t/gorV67US4l275/41OOOBwoDR8FgADW9jHIAHwwSPLUWO/b4tEzLREH2uqa5IWe2ftSKsaPh2Hw==',key_name='tempest-keypair-168588775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a180220b142349188245dd88298da020',ramdisk_id='',reservation_id='r-so1tb3rb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-874236545',owner_user_name='tempest-ServerActionsTestOtherB-874236545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe9d73d3e87c4ad4a1ff9afb4ee6a9b0',uuid=38108984-8bd8-49b6-9111-33c084a5a16a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converting VIF {"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG os_vif [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae2390d8-70, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae2390d8-70, col_values=(('external_ids', {'iface-id': 'ae2390d8-702c-478a-8f63-ff3c36403dc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:af:6f', 'vm-uuid': '38108984-8bd8-49b6-9111-33c084a5a16a'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Updating instance_info_cache with network_info: [{"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:36 user nova-compute[70914]: INFO os_vif [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70')
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Releasing lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Instance network_info: |[{"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] Acquired lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.network.neutron [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Refreshing network info cache for port fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Start _get_guest_xml network_info=[{"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:32:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464756.302344, 4cebb814-61ed-43f8-a4ec-a15abdcd265e => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] VM Started (Lifecycle Event)
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:32:36 user nova-compute[70914]: INFO nova.compute.manager [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Took 17.30 seconds to spawn the instance on the hypervisor.
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:36 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Instance spawned successfully.
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:32:36 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:36 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:32:36 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Instance spawned successfully.
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:32:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464756.5859249, e45fbfcb-0107-4410-b5e1-71ba56995748 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] VM Resumed (Lifecycle Event)
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:32:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] No VIF found with MAC fa:16:3e:5c:af:6f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1449190881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1449190881',id=7,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7SN82N9cHbn8PZ2TblgAVcZK0sG7UtXb4Z0VqVsC+Osl9+TR/LPm528kEW2qOsoj5UA5deDbyei2ofs9ec+lhrjzD1LESWEf6ptFZmyTIg81cYRyn+BKnc/rNS6rux7Q==',key_name='tempest-keypair-2139703863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c94597dacc420abba408e3b60f4a40',ramdisk_id='',reservation_id='r-xre3w9py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1997290170',owner_user_name='tempest-ServerActionsV293TestJSON-1997290170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9279e1abc6946bc970fa3b2b2119c67',uuid=d54b6163-cc14-44d4-91c6-d306168bb875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converting VIF {"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fa:fb,bridge_name='br-int',has_traffic_filtering=True,id=fc055a55-b554-442d-916b-59d5fbcd9868,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc055a55-b5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.objects.instance [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'pci_devices' on Instance uuid d54b6163-cc14-44d4-91c6-d306168bb875 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:37 user nova-compute[70914]: INFO nova.compute.manager [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Took 20.89 seconds to spawn the instance on the hypervisor.
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:37 user nova-compute[70914]: INFO nova.compute.manager [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Took 18.85 seconds to build instance.
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:32:37 user nova-compute[70914]:   <uuid>d54b6163-cc14-44d4-91c6-d306168bb875</uuid>
Jul 27 13:32:37 user nova-compute[70914]:   <name>instance-00000007</name>
Jul 27 13:32:37 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:32:37 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:32:37 user nova-compute[70914]:   <metadata>
Jul 27 13:32:37 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:32:37 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:32:37 user nova-compute[70914]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1449190881</nova:name>
Jul 27 13:32:37 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:32:36</nova:creationTime>
Jul 27 13:32:37 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:32:37 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:32:37 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:32:37 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:32:37 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:32:37 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:32:37 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:32:37 user nova-compute[70914]:       <nova:owner>
Jul 27 13:32:37 user nova-compute[70914]:         <nova:user uuid="a9279e1abc6946bc970fa3b2b2119c67">tempest-ServerActionsV293TestJSON-1997290170-project-member</nova:user>
Jul 27 13:32:37 user nova-compute[70914]:         <nova:project uuid="c4c94597dacc420abba408e3b60f4a40">tempest-ServerActionsV293TestJSON-1997290170</nova:project>
Jul 27 13:32:37 user nova-compute[70914]:       </nova:owner>
Jul 27 13:32:37 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:32:37 user nova-compute[70914]:       <nova:ports>
Jul 27 13:32:37 user nova-compute[70914]:         <nova:port uuid="fc055a55-b554-442d-916b-59d5fbcd9868">
Jul 27 13:32:37 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 13:32:37 user nova-compute[70914]:         </nova:port>
Jul 27 13:32:37 user nova-compute[70914]:       </nova:ports>
Jul 27 13:32:37 user nova-compute[70914]:     </nova:instance>
Jul 27 13:32:37 user nova-compute[70914]:   </metadata>
Jul 27 13:32:37 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:32:37 user nova-compute[70914]:     <system>
Jul 27 13:32:37 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:32:37 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:32:37 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:32:37 user nova-compute[70914]:       <entry name="serial">d54b6163-cc14-44d4-91c6-d306168bb875</entry>
Jul 27 13:32:37 user nova-compute[70914]:       <entry name="uuid">d54b6163-cc14-44d4-91c6-d306168bb875</entry>
Jul 27 13:32:37 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:32:37 user nova-compute[70914]:     </system>
Jul 27 13:32:37 user nova-compute[70914]:   </sysinfo>
Jul 27 13:32:37 user nova-compute[70914]:   <os>
Jul 27 13:32:37 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:32:37 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:32:37 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:32:37 user nova-compute[70914]:   </os>
Jul 27 13:32:37 user nova-compute[70914]:   <features>
Jul 27 13:32:37 user nova-compute[70914]:     <acpi/>
Jul 27 13:32:37 user nova-compute[70914]:     <apic/>
Jul 27 13:32:37 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:32:37 user nova-compute[70914]:   </features>
Jul 27 13:32:37 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:32:37 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:32:37 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:32:37 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:32:37 user nova-compute[70914]:   </clock>
Jul 27 13:32:37 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:32:37 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:32:37 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:32:37 user nova-compute[70914]:   </cpu>
Jul 27 13:32:37 user nova-compute[70914]:   <devices>
Jul 27 13:32:37 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:32:37 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:32:37 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk"/>
Jul 27 13:32:37 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:32:37 user nova-compute[70914]:     </disk>
Jul 27 13:32:37 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:32:37 user nova-compute[70914]:       <mac address="fa:16:3e:a4:fa:fb"/>
Jul 27 13:32:37 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:37 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:32:37 user nova-compute[70914]:       <target dev="tapfc055a55-b5"/>
Jul 27 13:32:37 user nova-compute[70914]:     </interface>
Jul 27 13:32:37 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:32:37 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/console.log" append="off"/>
Jul 27 13:32:37 user nova-compute[70914]:     </serial>
Jul 27 13:32:37 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:32:37 user nova-compute[70914]:     <video>
Jul 27 13:32:37 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:32:37 user nova-compute[70914]:     </video>
Jul 27 13:32:37 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:32:37 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:32:37 user nova-compute[70914]:     </rng>
Jul 27 13:32:37 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:32:37 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:32:37 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:32:37 user nova-compute[70914]:     </memballoon>
Jul 27 13:32:37 user nova-compute[70914]:   </devices>
Jul 27 13:32:37 user nova-compute[70914]: </domain>
Jul 27 13:32:37 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1449190881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1449190881',id=7,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7SN82N9cHbn8PZ2TblgAVcZK0sG7UtXb4Z0VqVsC+Osl9+TR/LPm528kEW2qOsoj5UA5deDbyei2ofs9ec+lhrjzD1LESWEf6ptFZmyTIg81cYRyn+BKnc/rNS6rux7Q==',key_name='tempest-keypair-2139703863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c94597dacc420abba408e3b60f4a40',ramdisk_id='',reservation_id='r-xre3w9py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1997290170',owner_user_name='tempest-ServerActionsV293TestJSON-1997290170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9279e1abc6946bc970fa3b2b2119c67',uuid=d54b6163-cc14-44d4-91c6-d306168bb875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converting VIF {"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fa:fb,bridge_name='br-int',has_traffic_filtering=True,id=fc055a55-b554-442d-916b-59d5fbcd9868,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc055a55-b5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG os_vif [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fa:fb,bridge_name='br-int',has_traffic_filtering=True,id=fc055a55-b554-442d-916b-59d5fbcd9868,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc055a55-b5') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc055a55-b5, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc055a55-b5, col_values=(('external_ids', {'iface-id': 'fc055a55-b554-442d-916b-59d5fbcd9868', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:fa:fb', 'vm-uuid': 'd54b6163-cc14-44d4-91c6-d306168bb875'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8b96fa03-8f31-4bb7-a251-fa2752551076 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.141s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:37 user nova-compute[70914]: INFO os_vif [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fa:fb,bridge_name='br-int',has_traffic_filtering=True,id=fc055a55-b554-442d-916b-59d5fbcd9868,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc055a55-b5')
Jul 27 13:32:37 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464756.6027322, e45fbfcb-0107-4410-b5e1-71ba56995748 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:37 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] VM Started (Lifecycle Event)
Jul 27 13:32:37 user nova-compute[70914]: INFO nova.compute.manager [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Took 24.23 seconds to spawn the instance on the hypervisor.
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:32:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] No VIF found with MAC fa:16:3e:a4:fa:fb, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:32:37 user nova-compute[70914]: INFO nova.compute.manager [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Took 22.00 seconds to build instance.
Jul 27 13:32:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9ccd6c90-a014-4b95-8272-135e64669509 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.166s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-d865e682-dbb7-4c92-904f-9b8d45f0b77b req-d2891752-737b-4956-a5ee-43560a32d222 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Received event network-vif-plugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d865e682-dbb7-4c92-904f-9b8d45f0b77b req-d2891752-737b-4956-a5ee-43560a32d222 service nova] Acquiring lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d865e682-dbb7-4c92-904f-9b8d45f0b77b req-d2891752-737b-4956-a5ee-43560a32d222 service nova] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d865e682-dbb7-4c92-904f-9b8d45f0b77b req-d2891752-737b-4956-a5ee-43560a32d222 service nova] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-d865e682-dbb7-4c92-904f-9b8d45f0b77b req-d2891752-737b-4956-a5ee-43560a32d222 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] No waiting events found dispatching network-vif-plugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:38 user nova-compute[70914]: WARNING nova.compute.manager [req-d865e682-dbb7-4c92-904f-9b8d45f0b77b req-d2891752-737b-4956-a5ee-43560a32d222 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Received unexpected event network-vif-plugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a for instance with vm_state building and task_state spawning.
Jul 27 13:32:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-0444f8de-4b00-43cc-899f-011dc68c25a4 req-9bba3ad6-9ecb-4883-96d5-d4d73e13e934 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0444f8de-4b00-43cc-899f-011dc68c25a4 req-9bba3ad6-9ecb-4883-96d5-d4d73e13e934 service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0444f8de-4b00-43cc-899f-011dc68c25a4 req-9bba3ad6-9ecb-4883-96d5-d4d73e13e934 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0444f8de-4b00-43cc-899f-011dc68c25a4 req-9bba3ad6-9ecb-4883-96d5-d4d73e13e934 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-0444f8de-4b00-43cc-899f-011dc68c25a4 req-9bba3ad6-9ecb-4883-96d5-d4d73e13e934 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:39 user nova-compute[70914]: WARNING nova.compute.manager [req-0444f8de-4b00-43cc-899f-011dc68c25a4 req-9bba3ad6-9ecb-4883-96d5-d4d73e13e934 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received unexpected event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with vm_state active and task_state None.
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Updated VIF entry in instance network info cache for port fc055a55-b554-442d-916b-59d5fbcd9868. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Updating instance_info_cache with network_info: [{"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] Releasing lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Received event network-vif-plugged-5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] Acquiring lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] No waiting events found dispatching network-vif-plugged-5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:39 user nova-compute[70914]: WARNING nova.compute.manager [req-0ec1512a-082d-4a4a-8674-c99fad1ff07c req-13c76c9d-4b95-468a-8f4e-7bdfb0699328 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Received unexpected event network-vif-plugged-5d3e91a2-f550-459c-ba68-1188ce457d32 for instance with vm_state building and task_state spawning.
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance spawned successfully.
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464756.749998, 1b676522-c547-497a-9b3b-8436f85c7f40 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:39 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] VM Resumed (Lifecycle Event)
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:32:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Instance spawned successfully.
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:39 user nova-compute[70914]: INFO nova.compute.manager [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Took 12.89 seconds to spawn the instance on the hypervisor.
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464756.7502306, 1b676522-c547-497a-9b3b-8436f85c7f40 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:39 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] VM Started (Lifecycle Event)
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:40 user nova-compute[70914]: INFO nova.compute.manager [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Took 27.40 seconds to build instance.
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464759.482146, bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] VM Resumed (Lifecycle Event)
Jul 27 13:32:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3f2742a6-8ed2-4b39-9710-27aa12484240 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "1b676522-c547-497a-9b3b-8436f85c7f40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.659s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:40 user nova-compute[70914]: INFO nova.compute.manager [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Took 14.25 seconds to build instance.
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0a9f078e-822c-49bc-8f38-0a1b6c018e5f tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.510s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464759.482274, bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] VM Started (Lifecycle Event)
Jul 27 13:32:40 user nova-compute[70914]: INFO nova.compute.manager [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Took 16.32 seconds to spawn the instance on the hypervisor.
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464759.6679628, 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] VM Resumed (Lifecycle Event)
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464759.6791565, 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] VM Started (Lifecycle Event)
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:40 user nova-compute[70914]: INFO nova.compute.manager [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Took 17.40 seconds to build instance.
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-f2586e8e-81bb-4c79-bd38-dd0beed8239d req-fda247ec-60bf-4c7c-ab16-dbb4254622af service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f2586e8e-81bb-4c79-bd38-dd0beed8239d req-fda247ec-60bf-4c7c-ab16-dbb4254622af service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f2586e8e-81bb-4c79-bd38-dd0beed8239d req-fda247ec-60bf-4c7c-ab16-dbb4254622af service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f2586e8e-81bb-4c79-bd38-dd0beed8239d req-fda247ec-60bf-4c7c-ab16-dbb4254622af service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-f2586e8e-81bb-4c79-bd38-dd0beed8239d req-fda247ec-60bf-4c7c-ab16-dbb4254622af service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:40 user nova-compute[70914]: WARNING nova.compute.manager [req-f2586e8e-81bb-4c79-bd38-dd0beed8239d req-fda247ec-60bf-4c7c-ab16-dbb4254622af service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state active and task_state None.
Jul 27 13:32:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cf44933a-a3c7-4349-9fa4-1056a9729e93 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.539s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-782bdc84-e9b8-486c-809a-6dd74f9ef8f4 req-44d55fb7-3a8a-4244-94d0-fb0e3f04b70a service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-782bdc84-e9b8-486c-809a-6dd74f9ef8f4 req-44d55fb7-3a8a-4244-94d0-fb0e3f04b70a service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-782bdc84-e9b8-486c-809a-6dd74f9ef8f4 req-44d55fb7-3a8a-4244-94d0-fb0e3f04b70a service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-782bdc84-e9b8-486c-809a-6dd74f9ef8f4 req-44d55fb7-3a8a-4244-94d0-fb0e3f04b70a service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-782bdc84-e9b8-486c-809a-6dd74f9ef8f4 req-44d55fb7-3a8a-4244-94d0-fb0e3f04b70a service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:41 user nova-compute[70914]: WARNING nova.compute.manager [req-782bdc84-e9b8-486c-809a-6dd74f9ef8f4 req-44d55fb7-3a8a-4244-94d0-fb0e3f04b70a service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received unexpected event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with vm_state active and task_state None.
Jul 27 13:32:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG nova.compute.manager [req-1cd489e1-101c-4a35-844a-74653ffb7522 req-9bcd44ff-2605-4b0d-9169-59ae047ffe65 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received event network-vif-plugged-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1cd489e1-101c-4a35-844a-74653ffb7522 req-9bcd44ff-2605-4b0d-9169-59ae047ffe65 service nova] Acquiring lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1cd489e1-101c-4a35-844a-74653ffb7522 req-9bcd44ff-2605-4b0d-9169-59ae047ffe65 service nova] Lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1cd489e1-101c-4a35-844a-74653ffb7522 req-9bcd44ff-2605-4b0d-9169-59ae047ffe65 service nova] Lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG nova.compute.manager [req-1cd489e1-101c-4a35-844a-74653ffb7522 req-9bcd44ff-2605-4b0d-9169-59ae047ffe65 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] No waiting events found dispatching network-vif-plugged-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:42 user nova-compute[70914]: WARNING nova.compute.manager [req-1cd489e1-101c-4a35-844a-74653ffb7522 req-9bcd44ff-2605-4b0d-9169-59ae047ffe65 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received unexpected event network-vif-plugged-fc055a55-b554-442d-916b-59d5fbcd9868 for instance with vm_state building and task_state spawning.
Jul 27 13:32:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.371s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG nova.compute.manager [req-673200c9-9254-485c-9f52-9b316ebf2da1 req-fd254b5f-6edc-4e08-a6af-e02fe3a60ab5 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-673200c9-9254-485c-9f52-9b316ebf2da1 req-fd254b5f-6edc-4e08-a6af-e02fe3a60ab5 service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-673200c9-9254-485c-9f52-9b316ebf2da1 req-fd254b5f-6edc-4e08-a6af-e02fe3a60ab5 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-673200c9-9254-485c-9f52-9b316ebf2da1 req-fd254b5f-6edc-4e08-a6af-e02fe3a60ab5 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG nova.compute.manager [req-673200c9-9254-485c-9f52-9b316ebf2da1 req-fd254b5f-6edc-4e08-a6af-e02fe3a60ab5 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:43 user nova-compute[70914]: WARNING nova.compute.manager [req-673200c9-9254-485c-9f52-9b316ebf2da1 req-fd254b5f-6edc-4e08-a6af-e02fe3a60ab5 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state active and task_state None.
Jul 27 13:32:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.425s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-56d696f4-0e5d-40dd-a46b-9795c1d62b33 req-a4c5b413-7335-4684-9ecd-c75aced21f46 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received event network-vif-plugged-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-56d696f4-0e5d-40dd-a46b-9795c1d62b33 req-a4c5b413-7335-4684-9ecd-c75aced21f46 service nova] Acquiring lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-56d696f4-0e5d-40dd-a46b-9795c1d62b33 req-a4c5b413-7335-4684-9ecd-c75aced21f46 service nova] Lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-56d696f4-0e5d-40dd-a46b-9795c1d62b33 req-a4c5b413-7335-4684-9ecd-c75aced21f46 service nova] Lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-56d696f4-0e5d-40dd-a46b-9795c1d62b33 req-a4c5b413-7335-4684-9ecd-c75aced21f46 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] No waiting events found dispatching network-vif-plugged-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:44 user nova-compute[70914]: WARNING nova.compute.manager [req-56d696f4-0e5d-40dd-a46b-9795c1d62b33 req-a4c5b413-7335-4684-9ecd-c75aced21f46 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received unexpected event network-vif-plugged-fc055a55-b554-442d-916b-59d5fbcd9868 for instance with vm_state building and task_state spawning.
Jul 27 13:32:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.380s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464765.3633764, 38108984-8bd8-49b6-9111-33c084a5a16a => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:45 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] VM Resumed (Lifecycle Event)
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:45 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance spawned successfully.
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:32:45 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Instance spawned successfully.
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:45 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464765.3807805, 38108984-8bd8-49b6-9111-33c084a5a16a => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:45 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] VM Started (Lifecycle Event)
Jul 27 13:32:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:45 user nova-compute[70914]: INFO nova.compute.manager [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Took 19.73 seconds to spawn the instance on the hypervisor.
Jul 27 13:32:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.451s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:46 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:32:46 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464765.412035, d54b6163-cc14-44d4-91c6-d306168bb875 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:46 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] VM Resumed (Lifecycle Event)
Jul 27 13:32:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-262fa6ef-fc5a-4ac6-a563-03baed277ace req-f44945b3-2956-45d8-b9de-664f34a17944 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-262fa6ef-fc5a-4ac6-a563-03baed277ace req-f44945b3-2956-45d8-b9de-664f34a17944 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-262fa6ef-fc5a-4ac6-a563-03baed277ace req-f44945b3-2956-45d8-b9de-664f34a17944 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-262fa6ef-fc5a-4ac6-a563-03baed277ace req-f44945b3-2956-45d8-b9de-664f34a17944 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-262fa6ef-fc5a-4ac6-a563-03baed277ace req-f44945b3-2956-45d8-b9de-664f34a17944 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:46 user nova-compute[70914]: WARNING nova.compute.manager [req-262fa6ef-fc5a-4ac6-a563-03baed277ace req-f44945b3-2956-45d8-b9de-664f34a17944 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state building and task_state spawning.
Jul 27 13:32:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:46 user nova-compute[70914]: INFO nova.compute.manager [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Took 17.74 seconds to spawn the instance on the hypervisor.
Jul 27 13:32:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:46 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:32:46 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464765.4288993, d54b6163-cc14-44d4-91c6-d306168bb875 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:32:46 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] VM Started (Lifecycle Event)
Jul 27 13:32:46 user nova-compute[70914]: INFO nova.compute.manager [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Took 21.19 seconds to build instance.
Jul 27 13:32:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:32:46 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:32:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-855aa583-d7d7-43e0-8fea-168d6867632a tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.359s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk --force-share --output=json" returned: 0 in 0.389s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:46 user nova-compute[70914]: INFO nova.compute.manager [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Took 19.10 seconds to build instance.
Jul 27 13:32:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bed9b088-1a7f-45e0-8197-de55f0f78d25 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "d54b6163-cc14-44d4-91c6-d306168bb875" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.345s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:32:47 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:47 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:32:47 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=26.051532745361328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:32:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-6b6d5320-ba05-4d4f-b0e6-b6f05002bd66 req-bbc774db-6aed-45dc-87ee-53a778a8bd77 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6b6d5320-ba05-4d4f-b0e6-b6f05002bd66 req-bbc774db-6aed-45dc-87ee-53a778a8bd77 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6b6d5320-ba05-4d4f-b0e6-b6f05002bd66 req-bbc774db-6aed-45dc-87ee-53a778a8bd77 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6b6d5320-ba05-4d4f-b0e6-b6f05002bd66 req-bbc774db-6aed-45dc-87ee-53a778a8bd77 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-6b6d5320-ba05-4d4f-b0e6-b6f05002bd66 req-bbc774db-6aed-45dc-87ee-53a778a8bd77 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:32:48 user nova-compute[70914]: WARNING nova.compute.manager [req-6b6d5320-ba05-4d4f-b0e6-b6f05002bd66 req-bbc774db-6aed-45dc-87ee-53a778a8bd77 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state active and task_state None.
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 4cebb814-61ed-43f8-a4ec-a15abdcd265e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 38108984-8bd8-49b6-9111-33c084a5a16a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance d54b6163-cc14-44d4-91c6-d306168bb875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Refreshing inventories for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Updating ProviderTree inventory for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Refreshing aggregate associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, aggregates: None {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 13:32:48 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Refreshing trait associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 13:32:49 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:32:49 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:32:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:32:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.071s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:32:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 13:32:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:32:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:32:51 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:32:51 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:32:52 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updating instance_info_cache with network_info: [{"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:32:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:32:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:32:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:32:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "695f355f-022f-4040-a24f-ac41e7f40dff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:32:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:56 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:32:56 user nova-compute[70914]: INFO nova.compute.claims [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Claim successful on node user
Jul 27 13:32:57 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:32:57 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:32:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.789s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:32:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:32:57 user nova-compute[70914]: DEBUG nova.network.neutron [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:32:57 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 27 13:32:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG nova.policy [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73cfd546f5ed4787a0683c5f57ba5544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb1d25b436a428cbced14f94a4316d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:32:58 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Creating image(s)
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "/opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "/opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "/opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "e451b23169b8b48894d3c380e8468253ea2a4f12" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "e451b23169b8b48894d3c380e8468253ea2a4f12" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12.part --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:32:58 user nova-compute[70914]: INFO nova.compute.claims [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Claim successful on node user
Jul 27 13:32:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12.part --force-share --output=json" returned: 0 in 0.212s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG nova.virt.images [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] ab7da204-98e1-4df5-bd12-889b33928fdf was qcow2, converting to raw {{(pid=70914) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12.part /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12.converted {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG nova.network.neutron [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Successfully created port: 469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:32:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12.part /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12.converted" returned: 0 in 0.177s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12.converted --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "e451b23169b8b48894d3c380e8468253ea2a4f12" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.986s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12 --force-share --output=json" returned: 0 in 0.171s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "e451b23169b8b48894d3c380e8468253ea2a4f12" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "e451b23169b8b48894d3c380e8468253ea2a4f12" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.772s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.772s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:32:59 user nova-compute[70914]: INFO nova.compute.claims [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Claim successful on node user
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:32:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12 --force-share --output=json" returned: 0 in 0.237s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12,backing_fmt=raw /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12,backing_fmt=raw /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk 1073741824" returned: 0 in 0.094s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "e451b23169b8b48894d3c380e8468253ea2a4f12" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.policy [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7831e5cefa7142c0a1ff99f0fcba6d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076bc6cb188749f29bd33e8d72fd5d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:32:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Creating image(s)
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12 --force-share --output=json" returned: 0 in 0.230s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Checking if we can resize image /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:32:59 user nova-compute[70914]: DEBUG nova.network.neutron [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Successfully updated port: 469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.compute.manager [req-b9d14f9a-f644-4a62-bce2-9d8ea1f53444 req-62d4f6b1-2d37-4a50-9c88-fd7b8b6ae999 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received event network-changed-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.compute.manager [req-b9d14f9a-f644-4a62-bce2-9d8ea1f53444 req-62d4f6b1-2d37-4a50-9c88-fd7b8b6ae999 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Refreshing instance network info cache due to event network-changed-469eb9f0-10ac-4941-8605-82eba3a20489. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b9d14f9a-f644-4a62-bce2-9d8ea1f53444 req-62d4f6b1-2d37-4a50-9c88-fd7b8b6ae999 service nova] Acquiring lock "refresh_cache-695f355f-022f-4040-a24f-ac41e7f40dff" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b9d14f9a-f644-4a62-bce2-9d8ea1f53444 req-62d4f6b1-2d37-4a50-9c88-fd7b8b6ae999 service nova] Acquired lock "refresh_cache-695f355f-022f-4040-a24f-ac41e7f40dff" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.network.neutron [req-b9d14f9a-f644-4a62-bce2-9d8ea1f53444 req-62d4f6b1-2d37-4a50-9c88-fd7b8b6ae999 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Refreshing network info cache for port 469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "refresh_cache-695f355f-022f-4040-a24f-ac41e7f40dff" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Cannot resize image /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.objects.instance [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lazy-loading 'migration_context' on Instance uuid 695f355f-022f-4040-a24f-ac41e7f40dff {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Ensure instance console log exists: /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.195s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.network.neutron [req-b9d14f9a-f644-4a62-bce2-9d8ea1f53444 req-62d4f6b1-2d37-4a50-9c88-fd7b8b6ae999 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk 1073741824" returned: 0 in 0.065s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.942s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.173s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:33:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Cannot resize image /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lazy-loading 'migration_context' on Instance uuid 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Ensure instance console log exists: /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.policy [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0dde816758840efad2e0217f62e1fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913df7f1d874417d8950295bc73d23f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.network.neutron [req-b9d14f9a-f644-4a62-bce2-9d8ea1f53444 req-62d4f6b1-2d37-4a50-9c88-fd7b8b6ae999 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:33:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Creating image(s)
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "/opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "/opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "/opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b9d14f9a-f644-4a62-bce2-9d8ea1f53444 req-62d4f6b1-2d37-4a50-9c88-fd7b8b6ae999 service nova] Releasing lock "refresh_cache-695f355f-022f-4040-a24f-ac41e7f40dff" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquired lock "refresh_cache-695f355f-022f-4040-a24f-ac41e7f40dff" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG nova.network.neutron [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.190s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.277s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk 1073741824" returned: 0 in 0.081s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.177s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Successfully created port: e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Successfully created port: 9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Cannot resize image /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lazy-loading 'migration_context' on Instance uuid 64c90716-f424-4909-92ad-958a04f5b5a1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Ensure instance console log exists: /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Updating instance_info_cache with network_info: [{"id": "469eb9f0-10ac-4941-8605-82eba3a20489", "address": "fa:16:3e:79:dd:84", "network": {"id": "c0aec8c2-7987-4c39-b429-f2d0344fb020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-678011263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb1d25b436a428cbced14f94a4316d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469eb9f0-10", "ovs_interfaceid": "469eb9f0-10ac-4941-8605-82eba3a20489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Releasing lock "refresh_cache-695f355f-022f-4040-a24f-ac41e7f40dff" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Instance network_info: |[{"id": "469eb9f0-10ac-4941-8605-82eba3a20489", "address": "fa:16:3e:79:dd:84", "network": {"id": "c0aec8c2-7987-4c39-b429-f2d0344fb020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-678011263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb1d25b436a428cbced14f94a4316d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469eb9f0-10", "ovs_interfaceid": "469eb9f0-10ac-4941-8605-82eba3a20489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Start _get_guest_xml network_info=[{"id": "469eb9f0-10ac-4941-8605-82eba3a20489", "address": "fa:16:3e:79:dd:84", "network": {"id": "c0aec8c2-7987-4c39-b429-f2d0344fb020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-678011263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb1d25b436a428cbced14f94a4316d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469eb9f0-10", "ovs_interfaceid": "469eb9f0-10ac-4941-8605-82eba3a20489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:32:45Z,direct_url=<?>,disk_format='qcow2',id=ab7da204-98e1-4df5-bd12-889b33928fdf,min_disk=0,min_ram=0,name='',owner='932c752c1c71473c948aaab8c2f151c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:32:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'scsi', 'image_id': 'ab7da204-98e1-4df5-bd12-889b33928fdf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:33:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:33:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:32:45Z,direct_url=<?>,disk_format='qcow2',id=ab7da204-98e1-4df5-bd12-889b33928fdf,min_disk=0,min_ram=0,name='',owner='932c752c1c71473c948aaab8c2f151c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:32:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1716635504',display_name='tempest-AttachSCSIVolumeTestJSON-server-1716635504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1716635504',id=8,image_ref='ab7da204-98e1-4df5-bd12-889b33928fdf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM761BzEauCPypEh+rg+WbKBiNLI7Yv3VLPFSUFazq14EcYoYq4zswd0J9Vb70UrW5Dzkmxbk9V6h/obUkNHv7gi7T2sSGrHyMTWHHJmGUeti+WtEcf1BN28HL6zE0rAzA==',key_name='tempest-keypair-198629953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb1d25b436a428cbced14f94a4316d4',ramdisk_id='',reservation_id='r-6qofligp',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ab7da204-98e1-4df5-bd12-889b33928fdf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2006123596',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2006123596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73cfd546f5ed4787a0683c5f57ba5544',uuid=695f355f-022f-4040-a24f-ac41e7f40dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469eb9f0-10ac-4941-8605-82eba3a20489", "address": "fa:16:3e:79:dd:84", "network": {"id": "c0aec8c2-7987-4c39-b429-f2d0344fb020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-678011263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb1d25b436a428cbced14f94a4316d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469eb9f0-10", "ovs_interfaceid": "469eb9f0-10ac-4941-8605-82eba3a20489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Converting VIF {"id": "469eb9f0-10ac-4941-8605-82eba3a20489", "address": "fa:16:3e:79:dd:84", "network": {"id": "c0aec8c2-7987-4c39-b429-f2d0344fb020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-678011263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb1d25b436a428cbced14f94a4316d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469eb9f0-10", "ovs_interfaceid": "469eb9f0-10ac-4941-8605-82eba3a20489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:dd:84,bridge_name='br-int',has_traffic_filtering=True,id=469eb9f0-10ac-4941-8605-82eba3a20489,network=Network(c0aec8c2-7987-4c39-b429-f2d0344fb020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469eb9f0-10') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.objects.instance [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lazy-loading 'pci_devices' on Instance uuid 695f355f-022f-4040-a24f-ac41e7f40dff {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:33:01 user nova-compute[70914]:   <uuid>695f355f-022f-4040-a24f-ac41e7f40dff</uuid>
Jul 27 13:33:01 user nova-compute[70914]:   <name>instance-00000008</name>
Jul 27 13:33:01 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:33:01 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:33:01 user nova-compute[70914]:   <metadata>
Jul 27 13:33:01 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:33:01 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:33:01 user nova-compute[70914]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1716635504</nova:name>
Jul 27 13:33:01 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:33:01</nova:creationTime>
Jul 27 13:33:01 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:33:01 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:33:01 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:33:01 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:33:01 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:33:01 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:33:01 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:33:01 user nova-compute[70914]:       <nova:owner>
Jul 27 13:33:01 user nova-compute[70914]:         <nova:user uuid="73cfd546f5ed4787a0683c5f57ba5544">tempest-AttachSCSIVolumeTestJSON-2006123596-project-member</nova:user>
Jul 27 13:33:01 user nova-compute[70914]:         <nova:project uuid="3fb1d25b436a428cbced14f94a4316d4">tempest-AttachSCSIVolumeTestJSON-2006123596</nova:project>
Jul 27 13:33:01 user nova-compute[70914]:       </nova:owner>
Jul 27 13:33:01 user nova-compute[70914]:       <nova:root type="image" uuid="ab7da204-98e1-4df5-bd12-889b33928fdf"/>
Jul 27 13:33:01 user nova-compute[70914]:       <nova:ports>
Jul 27 13:33:01 user nova-compute[70914]:         <nova:port uuid="469eb9f0-10ac-4941-8605-82eba3a20489">
Jul 27 13:33:01 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 13:33:01 user nova-compute[70914]:         </nova:port>
Jul 27 13:33:01 user nova-compute[70914]:       </nova:ports>
Jul 27 13:33:01 user nova-compute[70914]:     </nova:instance>
Jul 27 13:33:01 user nova-compute[70914]:   </metadata>
Jul 27 13:33:01 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:33:01 user nova-compute[70914]:     <system>
Jul 27 13:33:01 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:33:01 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:33:01 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:33:01 user nova-compute[70914]:       <entry name="serial">695f355f-022f-4040-a24f-ac41e7f40dff</entry>
Jul 27 13:33:01 user nova-compute[70914]:       <entry name="uuid">695f355f-022f-4040-a24f-ac41e7f40dff</entry>
Jul 27 13:33:01 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:33:01 user nova-compute[70914]:     </system>
Jul 27 13:33:01 user nova-compute[70914]:   </sysinfo>
Jul 27 13:33:01 user nova-compute[70914]:   <os>
Jul 27 13:33:01 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:33:01 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:33:01 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:33:01 user nova-compute[70914]:   </os>
Jul 27 13:33:01 user nova-compute[70914]:   <features>
Jul 27 13:33:01 user nova-compute[70914]:     <acpi/>
Jul 27 13:33:01 user nova-compute[70914]:     <apic/>
Jul 27 13:33:01 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:33:01 user nova-compute[70914]:   </features>
Jul 27 13:33:01 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:33:01 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:33:01 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:33:01 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:33:01 user nova-compute[70914]:   </clock>
Jul 27 13:33:01 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:33:01 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:33:01 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:33:01 user nova-compute[70914]:   </cpu>
Jul 27 13:33:01 user nova-compute[70914]:   <devices>
Jul 27 13:33:01 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:33:01 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:33:01 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk"/>
Jul 27 13:33:01 user nova-compute[70914]:       <target dev="sda" bus="scsi"/>
Jul 27 13:33:01 user nova-compute[70914]:       <address type="drive" controller="0" unit="0"/>
Jul 27 13:33:01 user nova-compute[70914]:     </disk>
Jul 27 13:33:01 user nova-compute[70914]:     <disk type="file" device="cdrom">
Jul 27 13:33:01 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 13:33:01 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk.config"/>
Jul 27 13:33:01 user nova-compute[70914]:       <target dev="sdb" bus="scsi"/>
Jul 27 13:33:01 user nova-compute[70914]:       <address type="drive" controller="0" unit="1"/>
Jul 27 13:33:01 user nova-compute[70914]:     </disk>
Jul 27 13:33:01 user nova-compute[70914]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 27 13:33:01 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:33:01 user nova-compute[70914]:       <mac address="fa:16:3e:79:dd:84"/>
Jul 27 13:33:01 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:33:01 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:33:01 user nova-compute[70914]:       <target dev="tap469eb9f0-10"/>
Jul 27 13:33:01 user nova-compute[70914]:     </interface>
Jul 27 13:33:01 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:33:01 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/console.log" append="off"/>
Jul 27 13:33:01 user nova-compute[70914]:     </serial>
Jul 27 13:33:01 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:33:01 user nova-compute[70914]:     <video>
Jul 27 13:33:01 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:33:01 user nova-compute[70914]:     </video>
Jul 27 13:33:01 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:33:01 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:33:01 user nova-compute[70914]:     </rng>
Jul 27 13:33:01 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:33:01 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:33:01 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:33:01 user nova-compute[70914]:     </memballoon>
Jul 27 13:33:01 user nova-compute[70914]:   </devices>
Jul 27 13:33:01 user nova-compute[70914]: </domain>
Jul 27 13:33:01 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1716635504',display_name='tempest-AttachSCSIVolumeTestJSON-server-1716635504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1716635504',id=8,image_ref='ab7da204-98e1-4df5-bd12-889b33928fdf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM761BzEauCPypEh+rg+WbKBiNLI7Yv3VLPFSUFazq14EcYoYq4zswd0J9Vb70UrW5Dzkmxbk9V6h/obUkNHv7gi7T2sSGrHyMTWHHJmGUeti+WtEcf1BN28HL6zE0rAzA==',key_name='tempest-keypair-198629953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb1d25b436a428cbced14f94a4316d4',ramdisk_id='',reservation_id='r-6qofligp',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ab7da204-98e1-4df5-bd12-889b33928fdf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2006123596',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2006123596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73cfd546f5ed4787a0683c5f57ba5544',uuid=695f355f-022f-4040-a24f-ac41e7f40dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469eb9f0-10ac-4941-8605-82eba3a20489", "address": "fa:16:3e:79:dd:84", "network": {"id": "c0aec8c2-7987-4c39-b429-f2d0344fb020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-678011263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb1d25b436a428cbced14f94a4316d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469eb9f0-10", "ovs_interfaceid": "469eb9f0-10ac-4941-8605-82eba3a20489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Converting VIF {"id": "469eb9f0-10ac-4941-8605-82eba3a20489", "address": "fa:16:3e:79:dd:84", "network": {"id": "c0aec8c2-7987-4c39-b429-f2d0344fb020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-678011263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb1d25b436a428cbced14f94a4316d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469eb9f0-10", "ovs_interfaceid": "469eb9f0-10ac-4941-8605-82eba3a20489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:dd:84,bridge_name='br-int',has_traffic_filtering=True,id=469eb9f0-10ac-4941-8605-82eba3a20489,network=Network(c0aec8c2-7987-4c39-b429-f2d0344fb020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469eb9f0-10') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG os_vif [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:dd:84,bridge_name='br-int',has_traffic_filtering=True,id=469eb9f0-10ac-4941-8605-82eba3a20489,network=Network(c0aec8c2-7987-4c39-b429-f2d0344fb020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469eb9f0-10') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap469eb9f0-10, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap469eb9f0-10, col_values=(('external_ids', {'iface-id': '469eb9f0-10ac-4941-8605-82eba3a20489', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:dd:84', 'vm-uuid': '695f355f-022f-4040-a24f-ac41e7f40dff'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:33:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:01 user nova-compute[70914]: INFO os_vif [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:dd:84,bridge_name='br-int',has_traffic_filtering=True,id=469eb9f0-10ac-4941-8605-82eba3a20489,network=Network(c0aec8c2-7987-4c39-b429-f2d0344fb020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469eb9f0-10')
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] No BDM found with device name sda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] No VIF found with MAC fa:16:3e:79:dd:84, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:33:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Using config drive
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Successfully updated port: e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "refresh_cache-64c90716-f424-4909-92ad-958a04f5b5a1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquired lock "refresh_cache-64c90716-f424-4909-92ad-958a04f5b5a1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-0366a6ab-6d03-4001-b0be-938c0d4e1c67 req-d47755d8-d3ad-4b4e-8cf1-ebf8545c5817 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received event network-changed-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-0366a6ab-6d03-4001-b0be-938c0d4e1c67 req-d47755d8-d3ad-4b4e-8cf1-ebf8545c5817 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Refreshing instance network info cache due to event network-changed-e2e00cc5-18ce-41df-869a-8bb12c7a1d37. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0366a6ab-6d03-4001-b0be-938c0d4e1c67 req-d47755d8-d3ad-4b4e-8cf1-ebf8545c5817 service nova] Acquiring lock "refresh_cache-64c90716-f424-4909-92ad-958a04f5b5a1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:33:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Creating config drive at /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk.config
Jul 27 13:33:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3gip0788 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3gip0788" returned: 0 in 0.054s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Successfully updated port: 9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquired lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-6648d426-1783-40d7-a3e4-416f42ad6d85 req-5af92c1e-bc97-4662-872b-c520ef98ee8c service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-changed-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-6648d426-1783-40d7-a3e4-416f42ad6d85 req-5af92c1e-bc97-4662-872b-c520ef98ee8c service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Refreshing instance network info cache due to event network-changed-9e24abbc-7b7d-4353-be75-303948818880. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6648d426-1783-40d7-a3e4-416f42ad6d85 req-5af92c1e-bc97-4662-872b-c520ef98ee8c service nova] Acquiring lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Updating instance_info_cache with network_info: [{"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Releasing lock "refresh_cache-64c90716-f424-4909-92ad-958a04f5b5a1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Instance network_info: |[{"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0366a6ab-6d03-4001-b0be-938c0d4e1c67 req-d47755d8-d3ad-4b4e-8cf1-ebf8545c5817 service nova] Acquired lock "refresh_cache-64c90716-f424-4909-92ad-958a04f5b5a1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.network.neutron [req-0366a6ab-6d03-4001-b0be-938c0d4e1c67 req-d47755d8-d3ad-4b4e-8cf1-ebf8545c5817 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Refreshing network info cache for port e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:33:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Start _get_guest_xml network_info=[{"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:33:03 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:33:03 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-797082345',display_name='tempest-TestVolumeSwap-server-797082345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-797082345',id=10,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8KlQ3pzcjPXsQ0JOERls5oAyFZqK43MLioNtFATzNlsSEPE5L3fx9LPplR7tgRQPn10e5lWPNFD90F8iQb82kyfv7LtKzTxPf/6t1VdKm40MYSfsYAbcbB+8DGZ0CM/A==',key_name='tempest-keypair-1136706634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='913df7f1d874417d8950295bc73d23f8',ramdisk_id='',reservation_id='r-nvidzjyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-831296',owner_user_name='tempest-TestVolumeSwap-831296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0dde816758840efad2e0217f62e1fa3',uuid=64c90716-f424-4909-92ad-958a04f5b5a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Converting VIF {"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:b4:20,bridge_name='br-int',has_traffic_filtering=True,id=e2e00cc5-18ce-41df-869a-8bb12c7a1d37,network=Network(eb25c627-6803-430a-b1e8-3606b16d2f7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e00cc5-18') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lazy-loading 'pci_devices' on Instance uuid 64c90716-f424-4909-92ad-958a04f5b5a1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:33:03 user nova-compute[70914]:   <uuid>64c90716-f424-4909-92ad-958a04f5b5a1</uuid>
Jul 27 13:33:03 user nova-compute[70914]:   <name>instance-0000000a</name>
Jul 27 13:33:03 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:33:03 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:33:03 user nova-compute[70914]:   <metadata>
Jul 27 13:33:03 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:33:03 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:name>tempest-TestVolumeSwap-server-797082345</nova:name>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:33:03</nova:creationTime>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:33:03 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:33:03 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:owner>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:user uuid="a0dde816758840efad2e0217f62e1fa3">tempest-TestVolumeSwap-831296-project-member</nova:user>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:project uuid="913df7f1d874417d8950295bc73d23f8">tempest-TestVolumeSwap-831296</nova:project>
Jul 27 13:33:03 user nova-compute[70914]:       </nova:owner>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:ports>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:port uuid="e2e00cc5-18ce-41df-869a-8bb12c7a1d37">
Jul 27 13:33:03 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:33:03 user nova-compute[70914]:         </nova:port>
Jul 27 13:33:03 user nova-compute[70914]:       </nova:ports>
Jul 27 13:33:03 user nova-compute[70914]:     </nova:instance>
Jul 27 13:33:03 user nova-compute[70914]:   </metadata>
Jul 27 13:33:03 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:33:03 user nova-compute[70914]:     <system>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="serial">64c90716-f424-4909-92ad-958a04f5b5a1</entry>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="uuid">64c90716-f424-4909-92ad-958a04f5b5a1</entry>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:33:03 user nova-compute[70914]:     </system>
Jul 27 13:33:03 user nova-compute[70914]:   </sysinfo>
Jul 27 13:33:03 user nova-compute[70914]:   <os>
Jul 27 13:33:03 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:33:03 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:33:03 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:33:03 user nova-compute[70914]:   </os>
Jul 27 13:33:03 user nova-compute[70914]:   <features>
Jul 27 13:33:03 user nova-compute[70914]:     <acpi/>
Jul 27 13:33:03 user nova-compute[70914]:     <apic/>
Jul 27 13:33:03 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:33:03 user nova-compute[70914]:   </features>
Jul 27 13:33:03 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:33:03 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:33:03 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:33:03 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:33:03 user nova-compute[70914]:   </clock>
Jul 27 13:33:03 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:33:03 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:33:03 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:33:03 user nova-compute[70914]:   </cpu>
Jul 27 13:33:03 user nova-compute[70914]:   <devices>
Jul 27 13:33:03 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:33:03 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:33:03 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk"/>
Jul 27 13:33:03 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:33:03 user nova-compute[70914]:     </disk>
Jul 27 13:33:03 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:33:03 user nova-compute[70914]:       <mac address="fa:16:3e:db:b4:20"/>
Jul 27 13:33:03 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:33:03 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:33:03 user nova-compute[70914]:       <target dev="tape2e00cc5-18"/>
Jul 27 13:33:03 user nova-compute[70914]:     </interface>
Jul 27 13:33:03 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:33:03 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/console.log" append="off"/>
Jul 27 13:33:03 user nova-compute[70914]:     </serial>
Jul 27 13:33:03 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:33:03 user nova-compute[70914]:     <video>
Jul 27 13:33:03 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:33:03 user nova-compute[70914]:     </video>
Jul 27 13:33:03 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:33:03 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:33:03 user nova-compute[70914]:     </rng>
Jul 27 13:33:03 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:33:03 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:33:03 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:33:03 user nova-compute[70914]:     </memballoon>
Jul 27 13:33:03 user nova-compute[70914]:   </devices>
Jul 27 13:33:03 user nova-compute[70914]: </domain>
Jul 27 13:33:03 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-797082345',display_name='tempest-TestVolumeSwap-server-797082345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-797082345',id=10,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8KlQ3pzcjPXsQ0JOERls5oAyFZqK43MLioNtFATzNlsSEPE5L3fx9LPplR7tgRQPn10e5lWPNFD90F8iQb82kyfv7LtKzTxPf/6t1VdKm40MYSfsYAbcbB+8DGZ0CM/A==',key_name='tempest-keypair-1136706634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='913df7f1d874417d8950295bc73d23f8',ramdisk_id='',reservation_id='r-nvidzjyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-831296',owner_user_name='tempest-TestVolumeSwap-831296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0dde816758840efad2e0217f62e1fa3',uuid=64c90716-f424-4909-92ad-958a04f5b5a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Converting VIF {"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:b4:20,bridge_name='br-int',has_traffic_filtering=True,id=e2e00cc5-18ce-41df-869a-8bb12c7a1d37,network=Network(eb25c627-6803-430a-b1e8-3606b16d2f7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e00cc5-18') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG os_vif [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:b4:20,bridge_name='br-int',has_traffic_filtering=True,id=e2e00cc5-18ce-41df-869a-8bb12c7a1d37,network=Network(eb25c627-6803-430a-b1e8-3606b16d2f7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e00cc5-18') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2e00cc5-18, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2e00cc5-18, col_values=(('external_ids', {'iface-id': 'e2e00cc5-18ce-41df-869a-8bb12c7a1d37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:b4:20', 'vm-uuid': '64c90716-f424-4909-92ad-958a04f5b5a1'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:03 user nova-compute[70914]: INFO os_vif [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:b4:20,bridge_name='br-int',has_traffic_filtering=True,id=e2e00cc5-18ce-41df-869a-8bb12c7a1d37,network=Network(eb25c627-6803-430a-b1e8-3606b16d2f7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e00cc5-18')
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] No VIF found with MAC fa:16:3e:db:b4:20, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updating instance_info_cache with network_info: [{"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Releasing lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Instance network_info: |[{"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6648d426-1783-40d7-a3e4-416f42ad6d85 req-5af92c1e-bc97-4662-872b-c520ef98ee8c service nova] Acquired lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-6648d426-1783-40d7-a3e4-416f42ad6d85 req-5af92c1e-bc97-4662-872b-c520ef98ee8c service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Refreshing network info cache for port 9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Start _get_guest_xml network_info=[{"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:33:03 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:33:03 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686130538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686130538',id=9,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEPkG6YoBHNN1m07ICeDwsyBe3EyiCC5ZWV6mXw/+7QEA9m0AfwawXSd08u+IL5UEExXheTC9Q9XOElwPRpKRh7aBnH+il5ROUwwz9yELcy4nnvhviPGllDQupgOGxxtw==',key_name='tempest-keypair-1523997644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076bc6cb188749f29bd33e8d72fd5d27',ramdisk_id='',reservation_id='r-4xtevblr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1370278240',owner_user_name='tempest-TaggedAttachmentsTest-1370278240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7831e5cefa7142c0a1ff99f0fcba6d12',uuid=74b5062f-99eb-44aa-911a-f5dd360923cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converting VIF {"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0c:51,bridge_name='br-int',has_traffic_filtering=True,id=9e24abbc-7b7d-4353-be75-303948818880,network=Network(d69b8cde-d4ad-4974-8435-d5add4c76553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e24abbc-7b') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lazy-loading 'pci_devices' on Instance uuid 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:33:03 user nova-compute[70914]:   <uuid>74b5062f-99eb-44aa-911a-f5dd360923cb</uuid>
Jul 27 13:33:03 user nova-compute[70914]:   <name>instance-00000009</name>
Jul 27 13:33:03 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:33:03 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:33:03 user nova-compute[70914]:   <metadata>
Jul 27 13:33:03 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:33:03 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:name>tempest-device-tagging-server-686130538</nova:name>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:33:03</nova:creationTime>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:33:03 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:33:03 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:owner>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:user uuid="7831e5cefa7142c0a1ff99f0fcba6d12">tempest-TaggedAttachmentsTest-1370278240-project-member</nova:user>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:project uuid="076bc6cb188749f29bd33e8d72fd5d27">tempest-TaggedAttachmentsTest-1370278240</nova:project>
Jul 27 13:33:03 user nova-compute[70914]:       </nova:owner>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:33:03 user nova-compute[70914]:       <nova:ports>
Jul 27 13:33:03 user nova-compute[70914]:         <nova:port uuid="9e24abbc-7b7d-4353-be75-303948818880">
Jul 27 13:33:03 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:33:03 user nova-compute[70914]:         </nova:port>
Jul 27 13:33:03 user nova-compute[70914]:       </nova:ports>
Jul 27 13:33:03 user nova-compute[70914]:     </nova:instance>
Jul 27 13:33:03 user nova-compute[70914]:   </metadata>
Jul 27 13:33:03 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:33:03 user nova-compute[70914]:     <system>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="serial">74b5062f-99eb-44aa-911a-f5dd360923cb</entry>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="uuid">74b5062f-99eb-44aa-911a-f5dd360923cb</entry>
Jul 27 13:33:03 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:33:03 user nova-compute[70914]:     </system>
Jul 27 13:33:03 user nova-compute[70914]:   </sysinfo>
Jul 27 13:33:03 user nova-compute[70914]:   <os>
Jul 27 13:33:03 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:33:03 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:33:03 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:33:03 user nova-compute[70914]:   </os>
Jul 27 13:33:03 user nova-compute[70914]:   <features>
Jul 27 13:33:03 user nova-compute[70914]:     <acpi/>
Jul 27 13:33:03 user nova-compute[70914]:     <apic/>
Jul 27 13:33:03 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:33:03 user nova-compute[70914]:   </features>
Jul 27 13:33:03 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:33:03 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:33:03 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:33:03 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:33:03 user nova-compute[70914]:   </clock>
Jul 27 13:33:03 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:33:03 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:33:03 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:33:03 user nova-compute[70914]:   </cpu>
Jul 27 13:33:03 user nova-compute[70914]:   <devices>
Jul 27 13:33:03 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:33:03 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:33:03 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk"/>
Jul 27 13:33:03 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:33:03 user nova-compute[70914]:     </disk>
Jul 27 13:33:03 user nova-compute[70914]:     <disk type="file" device="cdrom">
Jul 27 13:33:03 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 13:33:03 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk.config"/>
Jul 27 13:33:03 user nova-compute[70914]:       <target dev="hda" bus="ide"/>
Jul 27 13:33:03 user nova-compute[70914]:     </disk>
Jul 27 13:33:03 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:33:03 user nova-compute[70914]:       <mac address="fa:16:3e:27:0c:51"/>
Jul 27 13:33:03 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:33:03 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:33:03 user nova-compute[70914]:       <target dev="tap9e24abbc-7b"/>
Jul 27 13:33:03 user nova-compute[70914]:     </interface>
Jul 27 13:33:03 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:33:03 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/console.log" append="off"/>
Jul 27 13:33:03 user nova-compute[70914]:     </serial>
Jul 27 13:33:03 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:33:03 user nova-compute[70914]:     <video>
Jul 27 13:33:03 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:33:03 user nova-compute[70914]:     </video>
Jul 27 13:33:03 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:33:03 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:33:03 user nova-compute[70914]:     </rng>
Jul 27 13:33:03 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:33:03 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:33:03 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:33:03 user nova-compute[70914]:     </memballoon>
Jul 27 13:33:03 user nova-compute[70914]:   </devices>
Jul 27 13:33:03 user nova-compute[70914]: </domain>
Jul 27 13:33:03 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686130538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686130538',id=9,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEPkG6YoBHNN1m07ICeDwsyBe3EyiCC5ZWV6mXw/+7QEA9m0AfwawXSd08u+IL5UEExXheTC9Q9XOElwPRpKRh7aBnH+il5ROUwwz9yELcy4nnvhviPGllDQupgOGxxtw==',key_name='tempest-keypair-1523997644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076bc6cb188749f29bd33e8d72fd5d27',ramdisk_id='',reservation_id='r-4xtevblr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1370278240',owner_user_name='tempest-TaggedAttachmentsTest-1370278240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7831e5cefa7142c0a1ff99f0fcba6d12',uuid=74b5062f-99eb-44aa-911a-f5dd360923cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converting VIF {"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0c:51,bridge_name='br-int',has_traffic_filtering=True,id=9e24abbc-7b7d-4353-be75-303948818880,network=Network(d69b8cde-d4ad-4974-8435-d5add4c76553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e24abbc-7b') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG os_vif [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0c:51,bridge_name='br-int',has_traffic_filtering=True,id=9e24abbc-7b7d-4353-be75-303948818880,network=Network(d69b8cde-d4ad-4974-8435-d5add4c76553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e24abbc-7b') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e24abbc-7b, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e24abbc-7b, col_values=(('external_ids', {'iface-id': '9e24abbc-7b7d-4353-be75-303948818880', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:0c:51', 'vm-uuid': '74b5062f-99eb-44aa-911a-f5dd360923cb'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:03 user nova-compute[70914]: INFO os_vif [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0c:51,bridge_name='br-int',has_traffic_filtering=True,id=9e24abbc-7b7d-4353-be75-303948818880,network=Network(d69b8cde-d4ad-4974-8435-d5add4c76553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e24abbc-7b')
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] No BDM found with device name hda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] No VIF found with MAC fa:16:3e:27:0c:51, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:33:03 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Using config drive
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-0366a6ab-6d03-4001-b0be-938c0d4e1c67 req-d47755d8-d3ad-4b4e-8cf1-ebf8545c5817 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Updated VIF entry in instance network info cache for port e2e00cc5-18ce-41df-869a-8bb12c7a1d37. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-0366a6ab-6d03-4001-b0be-938c0d4e1c67 req-d47755d8-d3ad-4b4e-8cf1-ebf8545c5817 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Updating instance_info_cache with network_info: [{"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0366a6ab-6d03-4001-b0be-938c0d4e1c67 req-d47755d8-d3ad-4b4e-8cf1-ebf8545c5817 service nova] Releasing lock "refresh_cache-64c90716-f424-4909-92ad-958a04f5b5a1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:03 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Creating config drive at /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk.config
Jul 27 13:33:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp20rcp58x {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp20rcp58x" returned: 0 in 0.057s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:04 user nova-compute[70914]: DEBUG nova.network.neutron [req-6648d426-1783-40d7-a3e4-416f42ad6d85 req-5af92c1e-bc97-4662-872b-c520ef98ee8c service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updated VIF entry in instance network info cache for port 9e24abbc-7b7d-4353-be75-303948818880. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:33:04 user nova-compute[70914]: DEBUG nova.network.neutron [req-6648d426-1783-40d7-a3e4-416f42ad6d85 req-5af92c1e-bc97-4662-872b-c520ef98ee8c service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updating instance_info_cache with network_info: [{"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6648d426-1783-40d7-a3e4-416f42ad6d85 req-5af92c1e-bc97-4662-872b-c520ef98ee8c service nova] Releasing lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-98bc15ec-22ac-449a-a290-315d5d63ad6c req-4ba6edb1-e75b-4a15-9b0c-1bf2ef6b0f97 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received event network-vif-plugged-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-98bc15ec-22ac-449a-a290-315d5d63ad6c req-4ba6edb1-e75b-4a15-9b0c-1bf2ef6b0f97 service nova] Acquiring lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-98bc15ec-22ac-449a-a290-315d5d63ad6c req-4ba6edb1-e75b-4a15-9b0c-1bf2ef6b0f97 service nova] Lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-98bc15ec-22ac-449a-a290-315d5d63ad6c req-4ba6edb1-e75b-4a15-9b0c-1bf2ef6b0f97 service nova] Lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-98bc15ec-22ac-449a-a290-315d5d63ad6c req-4ba6edb1-e75b-4a15-9b0c-1bf2ef6b0f97 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] No waiting events found dispatching network-vif-plugged-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:33:06 user nova-compute[70914]: WARNING nova.compute.manager [req-98bc15ec-22ac-449a-a290-315d5d63ad6c req-4ba6edb1-e75b-4a15-9b0c-1bf2ef6b0f97 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received unexpected event network-vif-plugged-469eb9f0-10ac-4941-8605-82eba3a20489 for instance with vm_state building and task_state spawning.
Jul 27 13:33:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received event network-vif-plugged-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Acquiring lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] No waiting events found dispatching network-vif-plugged-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:33:08 user nova-compute[70914]: WARNING nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received unexpected event network-vif-plugged-469eb9f0-10ac-4941-8605-82eba3a20489 for instance with vm_state building and task_state spawning.
Jul 27 13:33:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received event network-vif-plugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] No waiting events found dispatching network-vif-plugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:33:08 user nova-compute[70914]: WARNING nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received unexpected event network-vif-plugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 for instance with vm_state building and task_state spawning.
Jul 27 13:33:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received event network-vif-plugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] No waiting events found dispatching network-vif-plugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:33:08 user nova-compute[70914]: WARNING nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received unexpected event network-vif-plugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 for instance with vm_state building and task_state spawning.
Jul 27 13:33:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:33:08 user nova-compute[70914]: WARNING nova.compute.manager [req-9ba00915-db8b-4d45-8b1a-2ca617ecc1f4 req-95e71b16-359b-450b-8c8c-75a5285072f7 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 for instance with vm_state building and task_state spawning.
Jul 27 13:33:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464790.4397836, 695f355f-022f-4040-a24f-ac41e7f40dff => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] VM Resumed (Lifecycle Event)
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Instance spawned successfully.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Instance spawned successfully.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464790.4404523, 695f355f-022f-4040-a24f-ac41e7f40dff => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] VM Started (Lifecycle Event)
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Took 12.38 seconds to spawn the instance on the hypervisor.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464790.4744477, 64c90716-f424-4909-92ad-958a04f5b5a1 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] VM Resumed (Lifecycle Event)
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Instance spawned successfully.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Took 9.89 seconds to spawn the instance on the hypervisor.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464790.4777882, 64c90716-f424-4909-92ad-958a04f5b5a1 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] VM Started (Lifecycle Event)
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Took 13.76 seconds to build instance.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79aa47c5-beef-4997-9fcf-8243363114db tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.915s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Took 10.88 seconds to spawn the instance on the hypervisor.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Took 12.10 seconds to build instance.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464790.5610752, 74b5062f-99eb-44aa-911a-f5dd360923cb => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] VM Resumed (Lifecycle Event)
Jul 27 13:33:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5229ed9d-46a5-451c-b903-1c17afdae0dd tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.528s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464790.5611959, 74b5062f-99eb-44aa-911a-f5dd360923cb => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] VM Started (Lifecycle Event)
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:33:10 user nova-compute[70914]: INFO nova.compute.manager [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Took 12.20 seconds to build instance.
Jul 27 13:33:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd4-77dd-4140-8373-125683aaf078 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.653s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-d5ad77fd-6a6f-4d31-a433-db4a61cac423 req-6b774755-6f20-44f2-98a4-85e9f3c93f99 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5ad77fd-6a6f-4d31-a433-db4a61cac423 req-6b774755-6f20-44f2-98a4-85e9f3c93f99 service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5ad77fd-6a6f-4d31-a433-db4a61cac423 req-6b774755-6f20-44f2-98a4-85e9f3c93f99 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5ad77fd-6a6f-4d31-a433-db4a61cac423 req-6b774755-6f20-44f2-98a4-85e9f3c93f99 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-d5ad77fd-6a6f-4d31-a433-db4a61cac423 req-6b774755-6f20-44f2-98a4-85e9f3c93f99 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:33:10 user nova-compute[70914]: WARNING nova.compute.manager [req-d5ad77fd-6a6f-4d31-a433-db4a61cac423 req-6b774755-6f20-44f2-98a4-85e9f3c93f99 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 for instance with vm_state active and task_state None.
Jul 27 13:33:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:33:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:33:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:33:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:33:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:33:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:33:32 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:33:32 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:33:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:33:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:33:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:33:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:33:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:34 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updating instance_info_cache with network_info: [{"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:33:38 user nova-compute[70914]: INFO nova.compute.claims [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Claim successful on node user
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:39 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:33:39 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=6811MB free_disk=25.693119049072266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.237s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.121s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:33:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 4cebb814-61ed-43f8-a4ec-a15abdcd265e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 38108984-8bd8-49b6-9111-33c084a5a16a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance d54b6163-cc14-44d4-91c6-d306168bb875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 695f355f-022f-4040-a24f-ac41e7f40dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 74b5062f-99eb-44aa-911a-f5dd360923cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 64c90716-f424-4909-92ad-958a04f5b5a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3be64a2f-e1e6-4a27-9360-11ca508386b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:33:39 user nova-compute[70914]: INFO nova.virt.block_device [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Booting with volume 675346a7-06c2-4b12-8cbf-c4d06766e30e at /dev/vda
Jul 27 13:33:39 user nova-compute[70914]: DEBUG nova.policy [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fa2b954d0fa4f1aa64145dda9b31076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356427cedead46c4888b388a48a4f091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:33:39 user nova-compute[70914]: DEBUG os_brick.utils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:33:39 user nova-compute[70914]: INFO oslo.privsep.daemon [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmph4kdd73n/privsep.sock']
Jul 27 13:33:39 user sudo[82162]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmph4kdd73n/privsep.sock
Jul 27 13:33:39 user sudo[82162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 13:33:40 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:33:40 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:33:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:33:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:33:40 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully created port: ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully created port: e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:33:41 user sudo[82162]: pam_unix(sudo:session): session closed for user root
Jul 27 13:33:41 user nova-compute[70914]: INFO oslo.privsep.daemon [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Spawned new privsep daemon via rootwrap
Jul 27 13:33:41 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 13:33:41 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 13:33:41 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 27 13:33:41 user nova-compute[70914]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82182
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8237b5e-5f04-4f62-8de3-0be6a8da8d3c]: (2,) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c892ab4-00dd-4413-a685-2089e293f0b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:41 user nova-compute[70914]: WARNING os_brick.initiator.connectors.nvmeof [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3540175d-7a4a-4f12-aa7e-690e8f931b1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc94f380-a38b-4c4f-a544-a238fd1330a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2706b084-a39a-4d14-8f6c-997fd3519205]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully created port: b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:33:41 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:33:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a91d3b-0239-4581-b327-630f30954347]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG os_brick.utils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] <== get_connector_properties: return (1993ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:33:41 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating existing volume attachment record: 2482a24e-3cb3-457a-9194-37e260dc2620 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:33:42 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully created port: 7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:33:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully created port: dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:33:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully updated port: ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:33:43 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4740717-ae2b-4f84-a31b-5c8d668ae3d6 req-1fe83312-076c-4a43-9917-1960a61b4741 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-changed-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:43 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4740717-ae2b-4f84-a31b-5c8d668ae3d6 req-1fe83312-076c-4a43-9917-1960a61b4741 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing instance network info cache due to event network-changed-ac119717-e6be-424f-9bc2-7961779c0b8a. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:33:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4740717-ae2b-4f84-a31b-5c8d668ae3d6 req-1fe83312-076c-4a43-9917-1960a61b4741 service nova] Acquiring lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4740717-ae2b-4f84-a31b-5c8d668ae3d6 req-1fe83312-076c-4a43-9917-1960a61b4741 service nova] Acquired lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:43 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4740717-ae2b-4f84-a31b-5c8d668ae3d6 req-1fe83312-076c-4a43-9917-1960a61b4741 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing network info cache for port ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:33:43 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4740717-ae2b-4f84-a31b-5c8d668ae3d6 req-1fe83312-076c-4a43-9917-1960a61b4741 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:33:44 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4740717-ae2b-4f84-a31b-5c8d668ae3d6 req-1fe83312-076c-4a43-9917-1960a61b4741 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4740717-ae2b-4f84-a31b-5c8d668ae3d6 req-1fe83312-076c-4a43-9917-1960a61b4741 service nova] Releasing lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully updated port: 8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:33:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully updated port: 6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:33:45 user nova-compute[70914]: DEBUG nova.compute.manager [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-changed-8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:45 user nova-compute[70914]: DEBUG nova.compute.manager [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing instance network info cache due to event network-changed-8df8e238-9f60-4f78-aca5-6ff9661859f8. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:33:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] Acquiring lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] Acquired lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:45 user nova-compute[70914]: DEBUG nova.network.neutron [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing network info cache for port 8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:33:46 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully updated port: e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:33:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:33:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] Releasing lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-changed-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing instance network info cache due to event network-changed-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:33:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] Acquiring lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] Acquired lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing network info cache for port 6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:33:47 user nova-compute[70914]: DEBUG nova.network.neutron [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:33:47 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully updated port: b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:33:47 user nova-compute[70914]: DEBUG nova.network.neutron [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0f15ba92-1387-46a3-aa3d-1c223e4ec654 req-84f25147-91d0-47ce-b07f-9fac03808982 service nova] Releasing lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:47 user nova-compute[70914]: DEBUG nova.compute.manager [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-changed-e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:47 user nova-compute[70914]: DEBUG nova.compute.manager [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing instance network info cache due to event network-changed-e67dafb4-ab9a-447c-9085-cb2f0aefd649. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:33:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] Acquiring lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] Acquired lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:47 user nova-compute[70914]: DEBUG nova.network.neutron [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing network info cache for port e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:33:47 user nova-compute[70914]: DEBUG nova.network.neutron [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully updated port: 7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG nova.network.neutron [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] Releasing lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-changed-b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing instance network info cache due to event network-changed-b3edd8d1-9395-4ae3-ae2b-74b998fc365b. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] Acquiring lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] Acquired lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG nova.network.neutron [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing network info cache for port b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG nova.network.neutron [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG nova.network.neutron [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6e1d3637-1b2a-4a2e-81a1-1c3b058f360e req-564ef3a1-bf68-4dcf-9daf-aed60cf09409 service nova] Releasing lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Successfully updated port: dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquired lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:33:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:33:49 user nova-compute[70914]: INFO nova.virt.block_device [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Booting with volume 1b90224b-16eb-4f52-b05e-673ae82d59e2 at /dev/vdb
Jul 27 13:33:49 user nova-compute[70914]: DEBUG os_brick.utils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b777e9-1285-4fff-884c-0925fbc85b6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7331545-adb4-49fe-ba8b-120bba735507]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b54ebe-ce2a-40bb-9e79-e8110e1aa50c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[05397422-e31a-4ab9-856c-75b5a79b1225]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:33:49 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc8efb1-74da-4d34-a0ec-cb2e180efbdb]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG os_brick.utils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating existing volume attachment record: 6633fe70-0140-4119-b7e5-101e73abf2db {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-changed-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing instance network info cache due to event network-changed-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:33:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] Acquiring lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:50 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [{"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Releasing lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Instance network_info: |[{"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:33:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] Acquired lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:50 user nova-compute[70914]: DEBUG nova.network.neutron [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing network info cache for port 7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:33:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updated VIF entry in instance network info cache for port 7c5dd309-e38f-40fb-84cb-0df58ac3f4e8. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:33:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [{"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] Releasing lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-changed-dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:33:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing instance network info cache due to event network-changed-dd97a90d-8b37-4f9d-b880-6c5b83595442. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:33:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] Acquiring lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:33:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] Acquired lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:33:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing network info cache for port dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:33:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updated VIF entry in instance network info cache for port dd97a90d-8b37-4f9d-b880-6c5b83595442. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:33:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [{"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:33:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-877fa887-05fd-43ff-96c5-d979130ec106 req-ad1ca33d-f7b3-44d5-956f-aaf11df17408 service nova] Releasing lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:33:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:33:56 user nova-compute[70914]: INFO nova.virt.block_device [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Booting with volume b8116e64-e6a7-4f84-95e1-573e7b92f19d at /dev/vdc
Jul 27 13:33:56 user nova-compute[70914]: DEBUG os_brick.utils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff687291-3596-41fd-81c6-43968c9f970f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d39f908-c0eb-48a6-ac2d-4598aa49aed4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d80f6f-7c6a-430c-9b93-a53268e0b309]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c3c38b-66d6-4bc7-bee5-63592eb4b307]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:33:56 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:33:56 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc2abde-1038-4186-9809-51f3373e8f59]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG os_brick.utils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:33:56 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating existing volume attachment record: 314b9fe8-2f17-4649-b4a7-1d6019a43167 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:33:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:34:03 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Creating image(s)
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Ensure instance console log exists: /opt/stack/data/nova/instances/3be64a2f-e1e6-4a27-9360-11ca508386b8/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Start _get_guest_xml network_info=[{"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '2482a24e-3cb3-457a-9194-37e260dc2620', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKbtyVlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3be64a2f-e1e6-4a27-9360-11ca508386b8', 'attached_at': '', 'detached_at': '', 'volume_id': '675346a7-06c2-4b12-8cbf-c4d06766e30e', 'serial': '675346a7-06c2-4b12-8cbf-c4d06766e30e'}, 'mount_device': '/dev/vda', 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '6633fe70-0140-4119-b7e5-101e73abf2db', 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGnTKiHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3be64a2f-e1e6-4a27-9360-11ca508386b8', 'attached_at': '', 'detached_at': '', 'volume_id': '1b90224b-16eb-4f52-b05e-673ae82d59e2', 'serial': '1b90224b-16eb-4f52-b05e-673ae82d59e2'}, 'mount_device': '/dev/vdb', 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '314b9fe8-2f17-4649-b4a7-1d6019a43167', 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmAQWoEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3be64a2f-e1e6-4a27-9360-11ca508386b8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8116e64-e6a7-4f84-95e1-573e7b92f19d', 'serial': 'b8116e64-e6a7-4f84-95e1-573e7b92f19d'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:34:03 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:03 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:34:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connector [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Factory for ISCSI on None {{(pid=70914) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKbtyVlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:04 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:04 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:04 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fe30a2-a4dd-459f-a5ae-923a8f472c15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:34:04 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9141b61-a712-46a3-9532-836c558be5ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e] added
Jul 27 13:34:04 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5abcd75-b592-4aa9-8ed4-113726beaf6e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[583b284a-3d59-4c49-be91-ebf8474bdec6]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKbtyVlM {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKbtyVlM" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c676866-0289-4ac4-9e05-e247aeed1d02]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKbtyVlM'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da4f60a-0858-4f76-89b5-1621a0e19405]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7036b865-068c-4218-97f0-ccab4bf6fc22]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 13:34:04 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 13:34:04 user nova-compute[70914]:  {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:04 user nova-compute[70914]: WARNING os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 13:34:04 user nova-compute[70914]: 
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f00fed1-80da-4422-b842-7764d07b0bb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e, portal: 172.16.0.220,3260]
Jul 27 13:34:04 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e, portal: 172.16.0.220,3260] successful.
Jul 27 13:34:04 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c65eb6-544d-4e78-aad7-880d850958bb]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[14136a14-f84a-43da-a6fc-2d10d350fd63]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:04 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:04 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c57d95-ad63-4a13-9050-20ef572e9b11]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:34:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKbtyVlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23165613537623465', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165613537623465', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGnTKiHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:05 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:05 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:05 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[542801f2-c591-4721-9489-c762424281a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:34:05 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1b2d31-bcbe-4028-b875-b4454b3b8a09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2] added
Jul 27 13:34:05 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7af62a-59de-43a4-8543-0754abc09a8b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0b2a2-e767-4ecc-8eaf-bf6d691fb81a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGnTKiHh {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGnTKiHh" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d54a798-8912-4e68-bc0f-70405c0d2a98]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tGnTKiHh'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f446e6-0cf8-46f5-bc9d-169fea3ace20]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcefaf4a-88f0-4eb5-9aa5-ed1b2778f756]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:05 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:05 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfd94dc-a37c-41fa-a782-8408ee79d7cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2, portal: 172.16.0.220,3260]
Jul 27 13:34:05 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2, portal: 172.16.0.220,3260] successful.
Jul 27 13:34:05 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9a5332-355f-47d1-892f-48a5cc615141]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6770d6ae-4dc8-4455-941f-a971e1a7c8c7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:05 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:05 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:05 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:05 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:34:05 user nova-compute[70914]: INFO nova.compute.manager [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Rescuing
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquired lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca68ed-22d4-4a63-af8a-11388ff8d4d7]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:34:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGnTKiHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updating instance_info_cache with network_info: [{"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Releasing lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-8e731d9e-dd8f-4ea6-931c-a53bcd9258eb req-d276b241-6187-49f7-bbed-8e38f127b33e service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-unplugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e731d9e-dd8f-4ea6-931c-a53bcd9258eb req-d276b241-6187-49f7-bbed-8e38f127b33e service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e731d9e-dd8f-4ea6-931c-a53bcd9258eb req-d276b241-6187-49f7-bbed-8e38f127b33e service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e731d9e-dd8f-4ea6-931c-a53bcd9258eb req-d276b241-6187-49f7-bbed-8e38f127b33e service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-8e731d9e-dd8f-4ea6-931c-a53bcd9258eb req-d276b241-6187-49f7-bbed-8e38f127b33e service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-unplugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:06 user nova-compute[70914]: WARNING nova.compute.manager [req-8e731d9e-dd8f-4ea6-931c-a53bcd9258eb req-d276b241-6187-49f7-bbed-8e38f127b33e service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received unexpected event network-vif-unplugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with vm_state active and task_state rescuing.
Jul 27 13:34:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23035306363376235', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035306363376235', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmAQWoEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:06 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:06 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:06 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a1e0e-c754-4dd4-b7b2-3100ca627d3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:34:06 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af233d6-5401-4c33-9ca9-62612109fa15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d] added
Jul 27 13:34:06 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d241b4-da5d-40fc-bcee-8449835f1f22]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ff9992-996e-4727-bc91-0c87edc1ba3e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmAQWoEL {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmAQWoEL" returned: 0 in 0.035s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7adb8f-943e-4269-a680-9192904e55bd]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TmAQWoEL'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[320e050c-9710-4907-852d-0ddfb53dd315]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b60b673-1cd0-4f01-9153-9da309508d87]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:06 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:06 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:06 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:06 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:07 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Instance destroyed successfully.
Jul 27 13:34:07 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Attempting rescue
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70914) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Instance directory exists: not creating {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 13:34:07 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Creating image(s)
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'trusted_certs' on Instance uuid e45fbfcb-0107-4410-b5e1-71ba56995748 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue" returned: 0 in 0.056s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'migration_context' on Instance uuid e45fbfcb-0107-4410-b5e1-71ba56995748 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Start _get_guest_xml network_info=[{"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "vif_mac": "fa:16:3e:0c:c5:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'resources' on Instance uuid e45fbfcb-0107-4410-b5e1-71ba56995748 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'numa_topology' on Instance uuid e45fbfcb-0107-4410-b5e1-71ba56995748 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:07 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:07 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'vcpu_model' on Instance uuid e45fbfcb-0107-4410-b5e1-71ba56995748 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-851597049',display_name='tempest-ServerRescueNegativeTestJSON-server-851597049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-851597049',id=2,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-oj84tw8y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:38Z,user_data=None,user_id='a0d92b0b34814e75a7709e09e357be07',uuid=e45fbfcb-0107-4410-b5e1-71ba56995748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "vif_mac": "fa:16:3e:0c:c5:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "vif_mac": "fa:16:3e:0c:c5:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=c29c2d71-8315-41b0-9029-d9cd7803d316,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29c2d71-83') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'pci_devices' on Instance uuid e45fbfcb-0107-4410-b5e1-71ba56995748 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:34:07 user nova-compute[70914]:   <uuid>e45fbfcb-0107-4410-b5e1-71ba56995748</uuid>
Jul 27 13:34:07 user nova-compute[70914]:   <name>instance-00000002</name>
Jul 27 13:34:07 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:34:07 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:34:07 user nova-compute[70914]:   <metadata>
Jul 27 13:34:07 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:34:07 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:34:07 user nova-compute[70914]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-851597049</nova:name>
Jul 27 13:34:07 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:34:07</nova:creationTime>
Jul 27 13:34:07 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:34:07 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:34:07 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:34:07 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:34:07 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:34:07 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:34:07 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:34:07 user nova-compute[70914]:       <nova:owner>
Jul 27 13:34:07 user nova-compute[70914]:         <nova:user uuid="a0d92b0b34814e75a7709e09e357be07">tempest-ServerRescueNegativeTestJSON-1275773337-project-member</nova:user>
Jul 27 13:34:07 user nova-compute[70914]:         <nova:project uuid="097b177edc7249f798bca2c39a33394d">tempest-ServerRescueNegativeTestJSON-1275773337</nova:project>
Jul 27 13:34:07 user nova-compute[70914]:       </nova:owner>
Jul 27 13:34:07 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:34:07 user nova-compute[70914]:       <nova:ports>
Jul 27 13:34:07 user nova-compute[70914]:         <nova:port uuid="c29c2d71-8315-41b0-9029-d9cd7803d316">
Jul 27 13:34:07 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 13:34:07 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:07 user nova-compute[70914]:       </nova:ports>
Jul 27 13:34:07 user nova-compute[70914]:     </nova:instance>
Jul 27 13:34:07 user nova-compute[70914]:   </metadata>
Jul 27 13:34:07 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:34:07 user nova-compute[70914]:     <system>
Jul 27 13:34:07 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:34:07 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:34:07 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:34:07 user nova-compute[70914]:       <entry name="serial">e45fbfcb-0107-4410-b5e1-71ba56995748</entry>
Jul 27 13:34:07 user nova-compute[70914]:       <entry name="uuid">e45fbfcb-0107-4410-b5e1-71ba56995748</entry>
Jul 27 13:34:07 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:34:07 user nova-compute[70914]:     </system>
Jul 27 13:34:07 user nova-compute[70914]:   </sysinfo>
Jul 27 13:34:07 user nova-compute[70914]:   <os>
Jul 27 13:34:07 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:34:07 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:34:07 user nova-compute[70914]:   </os>
Jul 27 13:34:07 user nova-compute[70914]:   <features>
Jul 27 13:34:07 user nova-compute[70914]:     <acpi/>
Jul 27 13:34:07 user nova-compute[70914]:     <apic/>
Jul 27 13:34:07 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:34:07 user nova-compute[70914]:   </features>
Jul 27 13:34:07 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:34:07 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:34:07 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:34:07 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:34:07 user nova-compute[70914]:   </clock>
Jul 27 13:34:07 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:34:07 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:34:07 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:34:07 user nova-compute[70914]:   </cpu>
Jul 27 13:34:07 user nova-compute[70914]:   <devices>
Jul 27 13:34:07 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:34:07 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:34:07 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue"/>
Jul 27 13:34:07 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:34:07 user nova-compute[70914]:     </disk>
Jul 27 13:34:07 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:34:07 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:34:07 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk"/>
Jul 27 13:34:07 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:34:07 user nova-compute[70914]:     </disk>
Jul 27 13:34:07 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:07 user nova-compute[70914]:       <mac address="fa:16:3e:0c:c5:fe"/>
Jul 27 13:34:07 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:07 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:07 user nova-compute[70914]:       <target dev="tapc29c2d71-83"/>
Jul 27 13:34:07 user nova-compute[70914]:     </interface>
Jul 27 13:34:07 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:34:07 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/console.log" append="off"/>
Jul 27 13:34:07 user nova-compute[70914]:     </serial>
Jul 27 13:34:07 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:34:07 user nova-compute[70914]:     <video>
Jul 27 13:34:07 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:07 user nova-compute[70914]:     </video>
Jul 27 13:34:07 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:34:07 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:34:07 user nova-compute[70914]:     </rng>
Jul 27 13:34:07 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:34:07 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:34:07 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:34:07 user nova-compute[70914]:     </memballoon>
Jul 27 13:34:07 user nova-compute[70914]:   </devices>
Jul 27 13:34:07 user nova-compute[70914]: </domain>
Jul 27 13:34:07 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:34:07 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Instance destroyed successfully.
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No VIF found with MAC fa:16:3e:0c:c5:fe, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --login" returned: 0 in 1.057s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b192373a-09e4-4e28-b1b8-dae5b31c6305]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d, portal: 172.16.0.220,3260]
Jul 27 13:34:07 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d, portal: 172.16.0.220,3260] successful.
Jul 27 13:34:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0609639f-acfb-4483-9dce-8df4199c2ff8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb7a718-2ec1-45e5-862e-789679234d07]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:08 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:08 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:08 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:08 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:08 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:08 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.305s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bedd60a-b179-4f9d-b992-721e82997f0f]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmAQWoEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-16b8f7b1-bf7c-407c-ab40-c91b517541b8 req-4cd17742-2b2d-4efc-9a06-3e7b8a47837b service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-16b8f7b1-bf7c-407c-ab40-c91b517541b8 req-4cd17742-2b2d-4efc-9a06-3e7b8a47837b service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-16b8f7b1-bf7c-407c-ab40-c91b517541b8 req-4cd17742-2b2d-4efc-9a06-3e7b8a47837b service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-16b8f7b1-bf7c-407c-ab40-c91b517541b8 req-4cd17742-2b2d-4efc-9a06-3e7b8a47837b service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-16b8f7b1-bf7c-407c-ab40-c91b517541b8 req-4cd17742-2b2d-4efc-9a06-3e7b8a47837b service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:08 user nova-compute[70914]: WARNING nova.compute.manager [req-16b8f7b1-bf7c-407c-ab40-c91b517541b8 req-4cd17742-2b2d-4efc-9a06-3e7b8a47837b service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received unexpected event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with vm_state active and task_state rescuing.
Jul 27 13:34:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.333s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] <== connect_volume: return (2334ms) {'type': 'block', 'scsi_wwn': '23335373038306161', 'path': '/dev/sdd'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335373038306161', 'path': '/dev/sdd'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:98:82,bridge_name='br-int',has_traffic_filtering=True,id=ac119717-e6be-424f-9bc2-7961779c0b8a,network=Network(e3a24c64-3a40-403a-b01e-3701bd72a372),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac119717-e6') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:d7:fc,bridge_name='br-int',has_traffic_filtering=True,id=8df8e238-9f60-4f78-aca5-6ff9661859f8,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8df8e238-9f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:ac:5f,bridge_name='br-int',has_traffic_filtering=True,id=6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6cc23f26-86') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:87,bridge_name='br-int',has_traffic_filtering=True,id=e67dafb4-ab9a-447c-9085-cb2f0aefd649,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67dafb4-ab') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:95:46,bridge_name='br-int',has_traffic_filtering=True,id=b3edd8d1-9395-4ae3-ae2b-74b998fc365b,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3edd8d1-93') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:2b,bridge_name='br-int',has_traffic_filtering=True,id=7c5dd309-e38f-40fb-84cb-0df58ac3f4e8,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5dd309-e3') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:69:4f,bridge_name='br-int',has_traffic_filtering=True,id=dd97a90d-8b37-4f9d-b880-6c5b83595442,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd97a90d-8b') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lazy-loading 'pci_devices' on Instance uuid 3be64a2f-e1e6-4a27-9360-11ca508386b8 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:34:09 user nova-compute[70914]:   <uuid>3be64a2f-e1e6-4a27-9360-11ca508386b8</uuid>
Jul 27 13:34:09 user nova-compute[70914]:   <name>instance-0000000b</name>
Jul 27 13:34:09 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:34:09 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:34:09 user nova-compute[70914]:   <metadata>
Jul 27 13:34:09 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:34:09 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:34:09 user nova-compute[70914]:       <nova:name>tempest-device-tagging-server-118158250</nova:name>
Jul 27 13:34:09 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:34:03</nova:creationTime>
Jul 27 13:34:09 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:34:09 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:34:09 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:34:09 user nova-compute[70914]:       <nova:owner>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:user uuid="1fa2b954d0fa4f1aa64145dda9b31076">tempest-TaggedBootDevicesTest_v242-55959234-project-member</nova:user>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:project uuid="356427cedead46c4888b388a48a4f091">tempest-TaggedBootDevicesTest_v242-55959234</nova:project>
Jul 27 13:34:09 user nova-compute[70914]:       </nova:owner>
Jul 27 13:34:09 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:34:09 user nova-compute[70914]:       <nova:ports>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:port uuid="ac119717-e6be-424f-9bc2-7961779c0b8a">
Jul 27 13:34:09 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 13:34:09 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:port uuid="8df8e238-9f60-4f78-aca5-6ff9661859f8">
Jul 27 13:34:09 user nova-compute[70914]:           <nova:ip type="fixed" address="10.1.1.48" ipVersion="4"/>
Jul 27 13:34:09 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:port uuid="6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf">
Jul 27 13:34:09 user nova-compute[70914]:           <nova:ip type="fixed" address="10.1.1.128" ipVersion="4"/>
Jul 27 13:34:09 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:port uuid="e67dafb4-ab9a-447c-9085-cb2f0aefd649">
Jul 27 13:34:09 user nova-compute[70914]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Jul 27 13:34:09 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:port uuid="b3edd8d1-9395-4ae3-ae2b-74b998fc365b">
Jul 27 13:34:09 user nova-compute[70914]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Jul 27 13:34:09 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:port uuid="7c5dd309-e38f-40fb-84cb-0df58ac3f4e8">
Jul 27 13:34:09 user nova-compute[70914]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 27 13:34:09 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:09 user nova-compute[70914]:         <nova:port uuid="dd97a90d-8b37-4f9d-b880-6c5b83595442">
Jul 27 13:34:09 user nova-compute[70914]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 27 13:34:09 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:09 user nova-compute[70914]:       </nova:ports>
Jul 27 13:34:09 user nova-compute[70914]:     </nova:instance>
Jul 27 13:34:09 user nova-compute[70914]:   </metadata>
Jul 27 13:34:09 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:34:09 user nova-compute[70914]:     <system>
Jul 27 13:34:09 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:34:09 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:34:09 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:34:09 user nova-compute[70914]:       <entry name="serial">3be64a2f-e1e6-4a27-9360-11ca508386b8</entry>
Jul 27 13:34:09 user nova-compute[70914]:       <entry name="uuid">3be64a2f-e1e6-4a27-9360-11ca508386b8</entry>
Jul 27 13:34:09 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:34:09 user nova-compute[70914]:     </system>
Jul 27 13:34:09 user nova-compute[70914]:   </sysinfo>
Jul 27 13:34:09 user nova-compute[70914]:   <os>
Jul 27 13:34:09 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:34:09 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:34:09 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:34:09 user nova-compute[70914]:   </os>
Jul 27 13:34:09 user nova-compute[70914]:   <features>
Jul 27 13:34:09 user nova-compute[70914]:     <acpi/>
Jul 27 13:34:09 user nova-compute[70914]:     <apic/>
Jul 27 13:34:09 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:34:09 user nova-compute[70914]:   </features>
Jul 27 13:34:09 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:34:09 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:34:09 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:34:09 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:34:09 user nova-compute[70914]:   </clock>
Jul 27 13:34:09 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:34:09 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:34:09 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:34:09 user nova-compute[70914]:   </cpu>
Jul 27 13:34:09 user nova-compute[70914]:   <devices>
Jul 27 13:34:09 user nova-compute[70914]:     <disk type="file" device="cdrom">
Jul 27 13:34:09 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 13:34:09 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/3be64a2f-e1e6-4a27-9360-11ca508386b8/disk.config"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="hda" bus="ide"/>
Jul 27 13:34:09 user nova-compute[70914]:     </disk>
Jul 27 13:34:09 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:34:09 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:34:09 user nova-compute[70914]:       <source dev="/dev/sdb"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:       <serial>675346a7-06c2-4b12-8cbf-c4d06766e30e</serial>
Jul 27 13:34:09 user nova-compute[70914]:     </disk>
Jul 27 13:34:09 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:34:09 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:34:09 user nova-compute[70914]:       <source dev="/dev/sdc"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:       <serial>1b90224b-16eb-4f52-b05e-673ae82d59e2</serial>
Jul 27 13:34:09 user nova-compute[70914]:     </disk>
Jul 27 13:34:09 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:34:09 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:34:09 user nova-compute[70914]:       <source dev="/dev/sdd"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="vdc" bus="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:       <serial>b8116e64-e6a7-4f84-95e1-573e7b92f19d</serial>
Jul 27 13:34:09 user nova-compute[70914]:     </disk>
Jul 27 13:34:09 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:09 user nova-compute[70914]:       <mac address="fa:16:3e:32:98:82"/>
Jul 27 13:34:09 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="tapac119717-e6"/>
Jul 27 13:34:09 user nova-compute[70914]:     </interface>
Jul 27 13:34:09 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:09 user nova-compute[70914]:       <mac address="fa:16:3e:60:d7:fc"/>
Jul 27 13:34:09 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="tap8df8e238-9f"/>
Jul 27 13:34:09 user nova-compute[70914]:     </interface>
Jul 27 13:34:09 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:09 user nova-compute[70914]:       <mac address="fa:16:3e:32:ac:5f"/>
Jul 27 13:34:09 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="tap6cc23f26-86"/>
Jul 27 13:34:09 user nova-compute[70914]:     </interface>
Jul 27 13:34:09 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:09 user nova-compute[70914]:       <mac address="fa:16:3e:18:69:87"/>
Jul 27 13:34:09 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="tape67dafb4-ab"/>
Jul 27 13:34:09 user nova-compute[70914]:     </interface>
Jul 27 13:34:09 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:09 user nova-compute[70914]:       <mac address="fa:16:3e:9a:95:46"/>
Jul 27 13:34:09 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="tapb3edd8d1-93"/>
Jul 27 13:34:09 user nova-compute[70914]:     </interface>
Jul 27 13:34:09 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:09 user nova-compute[70914]:       <mac address="fa:16:3e:8d:c7:2b"/>
Jul 27 13:34:09 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="tap7c5dd309-e3"/>
Jul 27 13:34:09 user nova-compute[70914]:     </interface>
Jul 27 13:34:09 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:09 user nova-compute[70914]:       <mac address="fa:16:3e:0c:69:4f"/>
Jul 27 13:34:09 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:09 user nova-compute[70914]:       <target dev="tapdd97a90d-8b"/>
Jul 27 13:34:09 user nova-compute[70914]:     </interface>
Jul 27 13:34:09 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:34:09 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/3be64a2f-e1e6-4a27-9360-11ca508386b8/console.log" append="off"/>
Jul 27 13:34:09 user nova-compute[70914]:     </serial>
Jul 27 13:34:09 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:34:09 user nova-compute[70914]:     <video>
Jul 27 13:34:09 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:09 user nova-compute[70914]:     </video>
Jul 27 13:34:09 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:34:09 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:34:09 user nova-compute[70914]:     </rng>
Jul 27 13:34:09 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:34:09 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:34:09 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:34:09 user nova-compute[70914]:     </memballoon>
Jul 27 13:34:09 user nova-compute[70914]:   </devices>
Jul 27 13:34:09 user nova-compute[70914]: </domain>
Jul 27 13:34:09 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:98:82,bridge_name='br-int',has_traffic_filtering=True,id=ac119717-e6be-424f-9bc2-7961779c0b8a,network=Network(e3a24c64-3a40-403a-b01e-3701bd72a372),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac119717-e6') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:98:82,bridge_name='br-int',has_traffic_filtering=True,id=ac119717-e6be-424f-9bc2-7961779c0b8a,network=Network(e3a24c64-3a40-403a-b01e-3701bd72a372),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac119717-e6') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac119717-e6, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac119717-e6, col_values=(('external_ids', {'iface-id': 'ac119717-e6be-424f-9bc2-7961779c0b8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:98:82', 'vm-uuid': '3be64a2f-e1e6-4a27-9360-11ca508386b8'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: INFO os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:98:82,bridge_name='br-int',has_traffic_filtering=True,id=ac119717-e6be-424f-9bc2-7961779c0b8a,network=Network(e3a24c64-3a40-403a-b01e-3701bd72a372),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac119717-e6')
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:d7:fc,bridge_name='br-int',has_traffic_filtering=True,id=8df8e238-9f60-4f78-aca5-6ff9661859f8,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8df8e238-9f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:d7:fc,bridge_name='br-int',has_traffic_filtering=True,id=8df8e238-9f60-4f78-aca5-6ff9661859f8,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8df8e238-9f') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8df8e238-9f, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8df8e238-9f, col_values=(('external_ids', {'iface-id': '8df8e238-9f60-4f78-aca5-6ff9661859f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:d7:fc', 'vm-uuid': '3be64a2f-e1e6-4a27-9360-11ca508386b8'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: INFO os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:d7:fc,bridge_name='br-int',has_traffic_filtering=True,id=8df8e238-9f60-4f78-aca5-6ff9661859f8,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8df8e238-9f')
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:ac:5f,bridge_name='br-int',has_traffic_filtering=True,id=6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6cc23f26-86') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:ac:5f,bridge_name='br-int',has_traffic_filtering=True,id=6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6cc23f26-86') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cc23f26-86, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6cc23f26-86, col_values=(('external_ids', {'iface-id': '6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:ac:5f', 'vm-uuid': '3be64a2f-e1e6-4a27-9360-11ca508386b8'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: INFO os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:ac:5f,bridge_name='br-int',has_traffic_filtering=True,id=6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6cc23f26-86')
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:87,bridge_name='br-int',has_traffic_filtering=True,id=e67dafb4-ab9a-447c-9085-cb2f0aefd649,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67dafb4-ab') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:87,bridge_name='br-int',has_traffic_filtering=True,id=e67dafb4-ab9a-447c-9085-cb2f0aefd649,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67dafb4-ab') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape67dafb4-ab, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape67dafb4-ab, col_values=(('external_ids', {'iface-id': 'e67dafb4-ab9a-447c-9085-cb2f0aefd649', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:69:87', 'vm-uuid': '3be64a2f-e1e6-4a27-9360-11ca508386b8'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: INFO os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:87,bridge_name='br-int',has_traffic_filtering=True,id=e67dafb4-ab9a-447c-9085-cb2f0aefd649,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67dafb4-ab')
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:95:46,bridge_name='br-int',has_traffic_filtering=True,id=b3edd8d1-9395-4ae3-ae2b-74b998fc365b,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3edd8d1-93') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:95:46,bridge_name='br-int',has_traffic_filtering=True,id=b3edd8d1-9395-4ae3-ae2b-74b998fc365b,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3edd8d1-93') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3edd8d1-93, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3edd8d1-93, col_values=(('external_ids', {'iface-id': 'b3edd8d1-9395-4ae3-ae2b-74b998fc365b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:95:46', 'vm-uuid': '3be64a2f-e1e6-4a27-9360-11ca508386b8'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: INFO os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:95:46,bridge_name='br-int',has_traffic_filtering=True,id=b3edd8d1-9395-4ae3-ae2b-74b998fc365b,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3edd8d1-93')
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:2b,bridge_name='br-int',has_traffic_filtering=True,id=7c5dd309-e38f-40fb-84cb-0df58ac3f4e8,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5dd309-e3') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:2b,bridge_name='br-int',has_traffic_filtering=True,id=7c5dd309-e38f-40fb-84cb-0df58ac3f4e8,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5dd309-e3') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c5dd309-e3, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c5dd309-e3, col_values=(('external_ids', {'iface-id': '7c5dd309-e38f-40fb-84cb-0df58ac3f4e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:c7:2b', 'vm-uuid': '3be64a2f-e1e6-4a27-9360-11ca508386b8'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: INFO os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:2b,bridge_name='br-int',has_traffic_filtering=True,id=7c5dd309-e38f-40fb-84cb-0df58ac3f4e8,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5dd309-e3')
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:69:4f,bridge_name='br-int',has_traffic_filtering=True,id=dd97a90d-8b37-4f9d-b880-6c5b83595442,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd97a90d-8b') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:69:4f,bridge_name='br-int',has_traffic_filtering=True,id=dd97a90d-8b37-4f9d-b880-6c5b83595442,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd97a90d-8b') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd97a90d-8b, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd97a90d-8b, col_values=(('external_ids', {'iface-id': 'dd97a90d-8b37-4f9d-b880-6c5b83595442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:69:4f', 'vm-uuid': '3be64a2f-e1e6-4a27-9360-11ca508386b8'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:09 user nova-compute[70914]: INFO os_vif [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:69:4f,bridge_name='br-int',has_traffic_filtering=True,id=dd97a90d-8b37-4f9d-b880-6c5b83595442,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd97a90d-8b')
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] No BDM found with device name hda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] No VIF found with MAC fa:16:3e:32:98:82, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] No VIF found with MAC fa:16:3e:9a:95:46, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:34:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Using config drive
Jul 27 13:34:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Creating config drive at /opt/stack/data/nova/instances/3be64a2f-e1e6-4a27-9360-11ca508386b8/disk.config
Jul 27 13:34:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3be64a2f-e1e6-4a27-9360-11ca508386b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbl3wok7p {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3be64a2f-e1e6-4a27-9360-11ca508386b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbl3wok7p" returned: 0 in 0.058s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:10 user nova-compute[70914]: WARNING nova.compute.manager [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received unexpected event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with vm_state active and task_state rescuing.
Jul 27 13:34:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:10 user nova-compute[70914]: WARNING nova.compute.manager [req-8ff36081-de93-43da-b2d1-81ac642ef1e6 req-7de4b1d6-8ede-4b63-b64d-0d299a5f9851 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received unexpected event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with vm_state active and task_state rescuing.
Jul 27 13:34:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for e45fbfcb-0107-4410-b5e1-71ba56995748 due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464851.3574746, e45fbfcb-0107-4410-b5e1-71ba56995748 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:11 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] VM Resumed (Lifecycle Event)
Jul 27 13:34:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f6df0a55-143b-4c97-a4f5-04e6280fc9e1 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:11 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 13:34:11 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464851.357677, e45fbfcb-0107-4410-b5e1-71ba56995748 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:11 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] VM Started (Lifecycle Event)
Jul 27 13:34:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:11 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 13:34:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-d7444eb1-bcfe-4e6a-9f7c-6905eb24e0fd req-45382b68-6466-473c-8eb7-0b724fdc4683 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d7444eb1-bcfe-4e6a-9f7c-6905eb24e0fd req-45382b68-6466-473c-8eb7-0b724fdc4683 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d7444eb1-bcfe-4e6a-9f7c-6905eb24e0fd req-45382b68-6466-473c-8eb7-0b724fdc4683 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d7444eb1-bcfe-4e6a-9f7c-6905eb24e0fd req-45382b68-6466-473c-8eb7-0b724fdc4683 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-d7444eb1-bcfe-4e6a-9f7c-6905eb24e0fd req-45382b68-6466-473c-8eb7-0b724fdc4683 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:11 user nova-compute[70914]: WARNING nova.compute.manager [req-d7444eb1-bcfe-4e6a-9f7c-6905eb24e0fd req-45382b68-6466-473c-8eb7-0b724fdc4683 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-ac119717-e6be-424f-9bc2-7961779c0b8a for instance with vm_state building and task_state spawning.
Jul 27 13:34:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lazy-loading 'flavor' on Instance uuid 4cebb814-61ed-43f8-a4ec-a15abdcd265e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG nova.compute.manager [req-d3d710e9-8de9-4ecd-ad3f-1e24fa409ff6 req-c8dd594d-89bf-43ed-83c5-e8dc6b6a7b07 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d3d710e9-8de9-4ecd-ad3f-1e24fa409ff6 req-c8dd594d-89bf-43ed-83c5-e8dc6b6a7b07 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d3d710e9-8de9-4ecd-ad3f-1e24fa409ff6 req-c8dd594d-89bf-43ed-83c5-e8dc6b6a7b07 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d3d710e9-8de9-4ecd-ad3f-1e24fa409ff6 req-c8dd594d-89bf-43ed-83c5-e8dc6b6a7b07 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG nova.compute.manager [req-d3d710e9-8de9-4ecd-ad3f-1e24fa409ff6 req-c8dd594d-89bf-43ed-83c5-e8dc6b6a7b07 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:12 user nova-compute[70914]: WARNING nova.compute.manager [req-d3d710e9-8de9-4ecd-ad3f-1e24fa409ff6 req-c8dd594d-89bf-43ed-83c5-e8dc6b6a7b07 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 for instance with vm_state building and task_state spawning.
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.134s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:12 user nova-compute[70914]: INFO nova.compute.manager [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Attaching volume dd44ab12-135b-42fd-9da8-f63754ad6634 to /dev/vdb
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG os_brick.utils [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a84921-b39e-4683-8637-8bb6f6eedf9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da24f82-5e94-43c8-9cb1-9c7f1b096d36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc121192-7fa6-4012-bf07-e8aa96832762]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f491d5-dcd1-47cd-ac2a-c96317eeb365]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:12 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:34:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a155905-e02f-4605-ac73-325fc71c2ee5]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG os_brick.utils [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Updating existing volume attachment record: f15d75cd-d1bb-4b00-bba0-a427c7054587 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:34:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-e7d0eadd-6d74-448a-9525-6e1a0a2cdc7d req-93f23e4b-6e37-45b6-aee9-edfd512c3bcd service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e7d0eadd-6d74-448a-9525-6e1a0a2cdc7d req-93f23e4b-6e37-45b6-aee9-edfd512c3bcd service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e7d0eadd-6d74-448a-9525-6e1a0a2cdc7d req-93f23e4b-6e37-45b6-aee9-edfd512c3bcd service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e7d0eadd-6d74-448a-9525-6e1a0a2cdc7d req-93f23e4b-6e37-45b6-aee9-edfd512c3bcd service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-e7d0eadd-6d74-448a-9525-6e1a0a2cdc7d req-93f23e4b-6e37-45b6-aee9-edfd512c3bcd service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:13 user nova-compute[70914]: WARNING nova.compute.manager [req-e7d0eadd-6d74-448a-9525-6e1a0a2cdc7d req-93f23e4b-6e37-45b6-aee9-edfd512c3bcd service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 for instance with vm_state building and task_state spawning.
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:13 user nova-compute[70914]: WARNING nova.compute.manager [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-ac119717-e6be-424f-9bc2-7961779c0b8a for instance with vm_state building and task_state spawning.
Jul 27 13:34:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:13 user nova-compute[70914]: WARNING nova.compute.manager [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b for instance with vm_state building and task_state spawning.
Jul 27 13:34:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:13 user nova-compute[70914]: WARNING nova.compute.manager [req-14d47082-b0fb-4320-b069-4b5a5482d872 req-2761fb7c-7b97-4aa1-893f-2b30f5156b2f service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b for instance with vm_state building and task_state spawning.
Jul 27 13:34:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:14 user nova-compute[70914]: WARNING nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 for instance with vm_state building and task_state spawning.
Jul 27 13:34:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:14 user nova-compute[70914]: WARNING nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf for instance with vm_state building and task_state spawning.
Jul 27 13:34:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:14 user nova-compute[70914]: WARNING nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf for instance with vm_state building and task_state spawning.
Jul 27 13:34:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:14 user nova-compute[70914]: WARNING nova.compute.manager [req-8cd700bd-44ed-4210-ad19-772baa2689d7 req-5a0847ab-4928-4200-b72f-44ec7dffb9f7 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 for instance with vm_state building and task_state spawning.
Jul 27 13:34:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "f50d948b-6955-4c9e-afa8-1a513ba1e715" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:34:15 user nova-compute[70914]: INFO nova.compute.claims [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Claim successful on node user
Jul 27 13:34:15 user nova-compute[70914]: DEBUG nova.compute.manager [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG nova.compute.manager [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:15 user nova-compute[70914]: WARNING nova.compute.manager [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 for instance with vm_state building and task_state spawning.
Jul 27 13:34:15 user nova-compute[70914]: DEBUG nova.compute.manager [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG nova.compute.manager [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:15 user nova-compute[70914]: WARNING nova.compute.manager [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 for instance with vm_state building and task_state spawning.
Jul 27 13:34:15 user nova-compute[70914]: DEBUG nova.compute.manager [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:15 user nova-compute[70914]: DEBUG nova.compute.manager [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:15 user nova-compute[70914]: WARNING nova.compute.manager [req-db2c5ee4-e8ed-4f02-ba1a-2e60989ffc37 req-cf24b095-ae0a-4dad-a97e-402e098e7746 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 for instance with vm_state building and task_state spawning.
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464856.1354566, 3be64a2f-e1e6-4a27-9360-11ca508386b8 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:16 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] VM Resumed (Lifecycle Event)
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:34:16 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Instance spawned successfully.
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:16 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464856.1374593, 3be64a2f-e1e6-4a27-9360-11ca508386b8 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:16 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] VM Started (Lifecycle Event)
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:16 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:34:16 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:34:16 user nova-compute[70914]: INFO nova.compute.manager [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Took 12.41 seconds to spawn the instance on the hypervisor.
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.policy [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84825f59c7be48698b64b0f24ab85b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59369b8cbb148fc9d60ef1513579205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:34:16 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Creating image(s)
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "/opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "/opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "/opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:16 user nova-compute[70914]: INFO nova.compute.manager [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Took 38.21 seconds to build instance.
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0694d99-4698-45fc-b7e8-5a3771469800 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.349s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [req-cd29f47a-4384-4de6-85b2-46fe372e6c02 req-df951baa-7d9a-4171-8903-de8d6fc73cc8 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cd29f47a-4384-4de6-85b2-46fe372e6c02 req-df951baa-7d9a-4171-8903-de8d6fc73cc8 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cd29f47a-4384-4de6-85b2-46fe372e6c02 req-df951baa-7d9a-4171-8903-de8d6fc73cc8 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cd29f47a-4384-4de6-85b2-46fe372e6c02 req-df951baa-7d9a-4171-8903-de8d6fc73cc8 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG nova.compute.manager [req-cd29f47a-4384-4de6-85b2-46fe372e6c02 req-df951baa-7d9a-4171-8903-de8d6fc73cc8 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:16 user nova-compute[70914]: WARNING nova.compute.manager [req-cd29f47a-4384-4de6-85b2-46fe372e6c02 req-df951baa-7d9a-4171-8903-de8d6fc73cc8 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 for instance with vm_state active and task_state None.
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk 1073741824" returned: 0 in 0.068s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.171s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Cannot resize image /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG nova.objects.instance [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lazy-loading 'migration_context' on Instance uuid f50d948b-6955-4c9e-afa8-1a513ba1e715 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Ensure instance console log exists: /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Successfully created port: fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-34e65d96-0a5f-4b22-968f-f04a1f6dd4f4 req-4ed5f892-1b9d-488b-b31b-7fd9c3197231 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-changed-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-34e65d96-0a5f-4b22-968f-f04a1f6dd4f4 req-4ed5f892-1b9d-488b-b31b-7fd9c3197231 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Refreshing instance network info cache due to event network-changed-ae2390d8-702c-478a-8f63-ff3c36403dc3. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-34e65d96-0a5f-4b22-968f-f04a1f6dd4f4 req-4ed5f892-1b9d-488b-b31b-7fd9c3197231 service nova] Acquiring lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-34e65d96-0a5f-4b22-968f-f04a1f6dd4f4 req-4ed5f892-1b9d-488b-b31b-7fd9c3197231 service nova] Acquired lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:17 user nova-compute[70914]: DEBUG nova.network.neutron [req-34e65d96-0a5f-4b22-968f-f04a1f6dd4f4 req-4ed5f892-1b9d-488b-b31b-7fd9c3197231 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Refreshing network info cache for port ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Successfully updated port: fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "refresh_cache-f50d948b-6955-4c9e-afa8-1a513ba1e715" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquired lock "refresh_cache-f50d948b-6955-4c9e-afa8-1a513ba1e715" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-c5bf9383-06b9-4655-917e-e618a31d2eeb req-94ee0f5e-df5a-45cd-835c-8488d2a95296 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Received event network-changed-fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-c5bf9383-06b9-4655-917e-e618a31d2eeb req-94ee0f5e-df5a-45cd-835c-8488d2a95296 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Refreshing instance network info cache due to event network-changed-fee95532-9ed0-41e0-8bad-6b789543939a. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c5bf9383-06b9-4655-917e-e618a31d2eeb req-94ee0f5e-df5a-45cd-835c-8488d2a95296 service nova] Acquiring lock "refresh_cache-f50d948b-6955-4c9e-afa8-1a513ba1e715" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-9b5208f4-e198-4e7a-a589-4af8485bdb07 req-72966bcd-3410-4369-8212-bd3ad2981605 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-changed-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-9b5208f4-e198-4e7a-a589-4af8485bdb07 req-72966bcd-3410-4369-8212-bd3ad2981605 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Refreshing instance network info cache due to event network-changed-3e9e022a-7a8b-42ed-b88f-2c32b880ee78. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9b5208f4-e198-4e7a-a589-4af8485bdb07 req-72966bcd-3410-4369-8212-bd3ad2981605 service nova] Acquiring lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9b5208f4-e198-4e7a-a589-4af8485bdb07 req-72966bcd-3410-4369-8212-bd3ad2981605 service nova] Acquired lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG nova.network.neutron [req-9b5208f4-e198-4e7a-a589-4af8485bdb07 req-72966bcd-3410-4369-8212-bd3ad2981605 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Refreshing network info cache for port 3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG nova.network.neutron [req-34e65d96-0a5f-4b22-968f-f04a1f6dd4f4 req-4ed5f892-1b9d-488b-b31b-7fd9c3197231 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updated VIF entry in instance network info cache for port ae2390d8-702c-478a-8f63-ff3c36403dc3. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG nova.network.neutron [req-34e65d96-0a5f-4b22-968f-f04a1f6dd4f4 req-4ed5f892-1b9d-488b-b31b-7fd9c3197231 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating instance_info_cache with network_info: [{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-34e65d96-0a5f-4b22-968f-f04a1f6dd4f4 req-4ed5f892-1b9d-488b-b31b-7fd9c3197231 service nova] Releasing lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Updating instance_info_cache with network_info: [{"id": "fee95532-9ed0-41e0-8bad-6b789543939a", "address": "fa:16:3e:38:ac:f3", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95532-9e", "ovs_interfaceid": "fee95532-9ed0-41e0-8bad-6b789543939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Releasing lock "refresh_cache-f50d948b-6955-4c9e-afa8-1a513ba1e715" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Instance network_info: |[{"id": "fee95532-9ed0-41e0-8bad-6b789543939a", "address": "fa:16:3e:38:ac:f3", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95532-9e", "ovs_interfaceid": "fee95532-9ed0-41e0-8bad-6b789543939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c5bf9383-06b9-4655-917e-e618a31d2eeb req-94ee0f5e-df5a-45cd-835c-8488d2a95296 service nova] Acquired lock "refresh_cache-f50d948b-6955-4c9e-afa8-1a513ba1e715" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.network.neutron [req-c5bf9383-06b9-4655-917e-e618a31d2eeb req-94ee0f5e-df5a-45cd-835c-8488d2a95296 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Refreshing network info cache for port fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Start _get_guest_xml network_info=[{"id": "fee95532-9ed0-41e0-8bad-6b789543939a", "address": "fa:16:3e:38:ac:f3", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95532-9e", "ovs_interfaceid": "fee95532-9ed0-41e0-8bad-6b789543939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:34:19 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:19 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2026646985',display_name='tempest-ServersNegativeTestJSON-server-2026646985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2026646985',id=12,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e59369b8cbb148fc9d60ef1513579205',ramdisk_id='',reservation_id='r-hc03isiv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1243391903',owner_user_name='tempest-ServersNegativeTestJSON-1243391903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:34:16Z,user_data=None,user_id='84825f59c7be48698b64b0f24ab85b1e',uuid=f50d948b-6955-4c9e-afa8-1a513ba1e715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee95532-9ed0-41e0-8bad-6b789543939a", "address": "fa:16:3e:38:ac:f3", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95532-9e", "ovs_interfaceid": "fee95532-9ed0-41e0-8bad-6b789543939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converting VIF {"id": "fee95532-9ed0-41e0-8bad-6b789543939a", "address": "fa:16:3e:38:ac:f3", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95532-9e", "ovs_interfaceid": "fee95532-9ed0-41e0-8bad-6b789543939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=fee95532-9ed0-41e0-8bad-6b789543939a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95532-9e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.objects.instance [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lazy-loading 'pci_devices' on Instance uuid f50d948b-6955-4c9e-afa8-1a513ba1e715 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:34:19 user nova-compute[70914]:   <uuid>f50d948b-6955-4c9e-afa8-1a513ba1e715</uuid>
Jul 27 13:34:19 user nova-compute[70914]:   <name>instance-0000000c</name>
Jul 27 13:34:19 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:34:19 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:34:19 user nova-compute[70914]:   <metadata>
Jul 27 13:34:19 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:34:19 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:34:19 user nova-compute[70914]:       <nova:name>tempest-ServersNegativeTestJSON-server-2026646985</nova:name>
Jul 27 13:34:19 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:34:19</nova:creationTime>
Jul 27 13:34:19 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:34:19 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:34:19 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:34:19 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:34:19 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:34:19 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:34:19 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:34:19 user nova-compute[70914]:       <nova:owner>
Jul 27 13:34:19 user nova-compute[70914]:         <nova:user uuid="84825f59c7be48698b64b0f24ab85b1e">tempest-ServersNegativeTestJSON-1243391903-project-member</nova:user>
Jul 27 13:34:19 user nova-compute[70914]:         <nova:project uuid="e59369b8cbb148fc9d60ef1513579205">tempest-ServersNegativeTestJSON-1243391903</nova:project>
Jul 27 13:34:19 user nova-compute[70914]:       </nova:owner>
Jul 27 13:34:19 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:34:19 user nova-compute[70914]:       <nova:ports>
Jul 27 13:34:19 user nova-compute[70914]:         <nova:port uuid="fee95532-9ed0-41e0-8bad-6b789543939a">
Jul 27 13:34:19 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 13:34:19 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:19 user nova-compute[70914]:       </nova:ports>
Jul 27 13:34:19 user nova-compute[70914]:     </nova:instance>
Jul 27 13:34:19 user nova-compute[70914]:   </metadata>
Jul 27 13:34:19 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:34:19 user nova-compute[70914]:     <system>
Jul 27 13:34:19 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:34:19 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:34:19 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:34:19 user nova-compute[70914]:       <entry name="serial">f50d948b-6955-4c9e-afa8-1a513ba1e715</entry>
Jul 27 13:34:19 user nova-compute[70914]:       <entry name="uuid">f50d948b-6955-4c9e-afa8-1a513ba1e715</entry>
Jul 27 13:34:19 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:34:19 user nova-compute[70914]:     </system>
Jul 27 13:34:19 user nova-compute[70914]:   </sysinfo>
Jul 27 13:34:19 user nova-compute[70914]:   <os>
Jul 27 13:34:19 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:34:19 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:34:19 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:34:19 user nova-compute[70914]:   </os>
Jul 27 13:34:19 user nova-compute[70914]:   <features>
Jul 27 13:34:19 user nova-compute[70914]:     <acpi/>
Jul 27 13:34:19 user nova-compute[70914]:     <apic/>
Jul 27 13:34:19 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:34:19 user nova-compute[70914]:   </features>
Jul 27 13:34:19 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:34:19 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:34:19 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:34:19 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:34:19 user nova-compute[70914]:   </clock>
Jul 27 13:34:19 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:34:19 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:34:19 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:34:19 user nova-compute[70914]:   </cpu>
Jul 27 13:34:19 user nova-compute[70914]:   <devices>
Jul 27 13:34:19 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:34:19 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:34:19 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk"/>
Jul 27 13:34:19 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:34:19 user nova-compute[70914]:     </disk>
Jul 27 13:34:19 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:19 user nova-compute[70914]:       <mac address="fa:16:3e:38:ac:f3"/>
Jul 27 13:34:19 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:19 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:19 user nova-compute[70914]:       <target dev="tapfee95532-9e"/>
Jul 27 13:34:19 user nova-compute[70914]:     </interface>
Jul 27 13:34:19 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:34:19 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/console.log" append="off"/>
Jul 27 13:34:19 user nova-compute[70914]:     </serial>
Jul 27 13:34:19 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:34:19 user nova-compute[70914]:     <video>
Jul 27 13:34:19 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:19 user nova-compute[70914]:     </video>
Jul 27 13:34:19 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:34:19 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:34:19 user nova-compute[70914]:     </rng>
Jul 27 13:34:19 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:34:19 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:34:19 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:34:19 user nova-compute[70914]:     </memballoon>
Jul 27 13:34:19 user nova-compute[70914]:   </devices>
Jul 27 13:34:19 user nova-compute[70914]: </domain>
Jul 27 13:34:19 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2026646985',display_name='tempest-ServersNegativeTestJSON-server-2026646985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2026646985',id=12,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e59369b8cbb148fc9d60ef1513579205',ramdisk_id='',reservation_id='r-hc03isiv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1243391903',owner_user_name='tempest-ServersNegativeTestJSON-1243391903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:34:16Z,user_data=None,user_id='84825f59c7be48698b64b0f24ab85b1e',uuid=f50d948b-6955-4c9e-afa8-1a513ba1e715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee95532-9ed0-41e0-8bad-6b789543939a", "address": "fa:16:3e:38:ac:f3", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95532-9e", "ovs_interfaceid": "fee95532-9ed0-41e0-8bad-6b789543939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converting VIF {"id": "fee95532-9ed0-41e0-8bad-6b789543939a", "address": "fa:16:3e:38:ac:f3", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95532-9e", "ovs_interfaceid": "fee95532-9ed0-41e0-8bad-6b789543939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=fee95532-9ed0-41e0-8bad-6b789543939a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95532-9e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG os_vif [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=fee95532-9ed0-41e0-8bad-6b789543939a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95532-9e') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfee95532-9e, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfee95532-9e, col_values=(('external_ids', {'iface-id': 'fee95532-9ed0-41e0-8bad-6b789543939a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ac:f3', 'vm-uuid': 'f50d948b-6955-4c9e-afa8-1a513ba1e715'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:19 user nova-compute[70914]: INFO os_vif [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=fee95532-9ed0-41e0-8bad-6b789543939a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95532-9e')
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] No VIF found with MAC fa:16:3e:38:ac:f3, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-5f69dbb7-3e80-409b-bb1c-b0b4edbaa551 req-b902c500-1d92-4bf6-af62-9b1a0301ea04 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received event network-changed-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-5f69dbb7-3e80-409b-bb1c-b0b4edbaa551 req-b902c500-1d92-4bf6-af62-9b1a0301ea04 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Refreshing instance network info cache due to event network-changed-fc055a55-b554-442d-916b-59d5fbcd9868. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5f69dbb7-3e80-409b-bb1c-b0b4edbaa551 req-b902c500-1d92-4bf6-af62-9b1a0301ea04 service nova] Acquiring lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5f69dbb7-3e80-409b-bb1c-b0b4edbaa551 req-b902c500-1d92-4bf6-af62-9b1a0301ea04 service nova] Acquired lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.network.neutron [req-5f69dbb7-3e80-409b-bb1c-b0b4edbaa551 req-b902c500-1d92-4bf6-af62-9b1a0301ea04 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Refreshing network info cache for port fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.network.neutron [req-9b5208f4-e198-4e7a-a589-4af8485bdb07 req-72966bcd-3410-4369-8212-bd3ad2981605 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updated VIF entry in instance network info cache for port 3e9e022a-7a8b-42ed-b88f-2c32b880ee78. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG nova.network.neutron [req-9b5208f4-e198-4e7a-a589-4af8485bdb07 req-72966bcd-3410-4369-8212-bd3ad2981605 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updating instance_info_cache with network_info: [{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9b5208f4-e198-4e7a-a589-4af8485bdb07 req-72966bcd-3410-4369-8212-bd3ad2981605 service nova] Releasing lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-c5bf9383-06b9-4655-917e-e618a31d2eeb req-94ee0f5e-df5a-45cd-835c-8488d2a95296 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Updated VIF entry in instance network info cache for port fee95532-9ed0-41e0-8bad-6b789543939a. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:34:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-c5bf9383-06b9-4655-917e-e618a31d2eeb req-94ee0f5e-df5a-45cd-835c-8488d2a95296 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Updating instance_info_cache with network_info: [{"id": "fee95532-9ed0-41e0-8bad-6b789543939a", "address": "fa:16:3e:38:ac:f3", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95532-9e", "ovs_interfaceid": "fee95532-9ed0-41e0-8bad-6b789543939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c5bf9383-06b9-4655-917e-e618a31d2eeb req-94ee0f5e-df5a-45cd-835c-8488d2a95296 service nova] Releasing lock "refresh_cache-f50d948b-6955-4c9e-afa8-1a513ba1e715" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-5f69dbb7-3e80-409b-bb1c-b0b4edbaa551 req-b902c500-1d92-4bf6-af62-9b1a0301ea04 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Updated VIF entry in instance network info cache for port fc055a55-b554-442d-916b-59d5fbcd9868. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:34:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-5f69dbb7-3e80-409b-bb1c-b0b4edbaa551 req-b902c500-1d92-4bf6-af62-9b1a0301ea04 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Updating instance_info_cache with network_info: [{"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5f69dbb7-3e80-409b-bb1c-b0b4edbaa551 req-b902c500-1d92-4bf6-af62-9b1a0301ea04 service nova] Releasing lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-3630b4a8-b0f0-4128-b528-45402238b232 req-dcfc4d4b-c776-4dc2-985c-9e9e82f58234 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Received event network-vif-plugged-fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3630b4a8-b0f0-4128-b528-45402238b232 req-dcfc4d4b-c776-4dc2-985c-9e9e82f58234 service nova] Acquiring lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3630b4a8-b0f0-4128-b528-45402238b232 req-dcfc4d4b-c776-4dc2-985c-9e9e82f58234 service nova] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3630b4a8-b0f0-4128-b528-45402238b232 req-dcfc4d4b-c776-4dc2-985c-9e9e82f58234 service nova] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-3630b4a8-b0f0-4128-b528-45402238b232 req-dcfc4d4b-c776-4dc2-985c-9e9e82f58234 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] No waiting events found dispatching network-vif-plugged-fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:21 user nova-compute[70914]: WARNING nova.compute.manager [req-3630b4a8-b0f0-4128-b528-45402238b232 req-dcfc4d4b-c776-4dc2-985c-9e9e82f58234 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Received unexpected event network-vif-plugged-fee95532-9ed0-41e0-8bad-6b789543939a for instance with vm_state building and task_state spawning.
Jul 27 13:34:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AvgUesOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:21 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:21 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:21 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[088653b9-5145-41cc-a1ae-60f2b5fbd22d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:34:21 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36d2f60-5d0c-4029-bfb2-cf88a7d31d10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634] added
Jul 27 13:34:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eced47-ec62-4877-b16f-781143db5acc]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30ab8c6-ae2a-4bb6-85f1-e16a6700bd34]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AvgUesOG {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AvgUesOG" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7cab00-351b-4508-ad29-06dc3a1028c2]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AvgUesOG'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a9640f-5364-461b-ab20-89407c4687f8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67284c1-0e8f-41e9-839f-2996dcf4506d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:21 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:21 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:21 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:21 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9022e44-5d9e-4136-82ac-97830e6c7bdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634, portal: 172.16.0.220,3260]
Jul 27 13:34:22 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634, portal: 172.16.0.220,3260] successful.
Jul 27 13:34:22 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0f78f4-dea8-4457-a09f-20764d817da1]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8ea988-d795-4fca-8ff4-39cc8f90f144]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:22 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:22 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:22 user nova-compute[70914]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 (non-flash)
Jul 27 13:34:22 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:22 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:22 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:22 user nova-compute[70914]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 (non-flash)
Jul 27 13:34:22 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efd7006-dc0c-4813-8de0-d40cbae36443]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AvgUesOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG nova.objects.instance [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:22 user nova-compute[70914]: INFO nova.compute.manager [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Attaching volume 216beadf-a53f-4a8f-afbd-87ee5dea9fb4 to /dev/vdb
Jul 27 13:34:23 user nova-compute[70914]: DEBUG os_brick.utils [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef5f22f-589d-4d82-bcc8-0a0c20741516]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9832aaa-b57d-4887-a1cb-e3ae2c9cd5c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[299e7da0-ef03-404d-b824-619c63c8d3e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b9b5f0-45ad-44df-b6d3-ee04a7c4c0a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23034666639333936', 'path': '/dev/sde'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034666639333936', 'path': '/dev/sde'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:23 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb043fab-61e6-4eb1-8cea-57240605a27d]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG os_brick.utils [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updating existing volume attachment record: f4471c17-a97a-4d18-bda8-6455d6725445 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lazy-loading 'flavor' on Instance uuid 4cebb814-61ed-43f8-a4ec-a15abdcd265e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:34:23 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:34:23 user nova-compute[70914]:   <source dev="/dev/sde"/>
Jul 27 13:34:23 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:34:23 user nova-compute[70914]:   <serial>dd44ab12-135b-42fd-9da8-f63754ad6634</serial>
Jul 27 13:34:23 user nova-compute[70914]: </disk>
Jul 27 13:34:23 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] No VIF found with MAC fa:16:3e:53:ef:86, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-f44dfaf9-3f18-49c8-88ff-c38ca7ee7d07 req-0c768ee4-9c82-4c2d-8081-54c6668919ed service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Received event network-vif-plugged-fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f44dfaf9-3f18-49c8-88ff-c38ca7ee7d07 req-0c768ee4-9c82-4c2d-8081-54c6668919ed service nova] Acquiring lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f44dfaf9-3f18-49c8-88ff-c38ca7ee7d07 req-0c768ee4-9c82-4c2d-8081-54c6668919ed service nova] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f44dfaf9-3f18-49c8-88ff-c38ca7ee7d07 req-0c768ee4-9c82-4c2d-8081-54c6668919ed service nova] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-f44dfaf9-3f18-49c8-88ff-c38ca7ee7d07 req-0c768ee4-9c82-4c2d-8081-54c6668919ed service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] No waiting events found dispatching network-vif-plugged-fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:23 user nova-compute[70914]: WARNING nova.compute.manager [req-f44dfaf9-3f18-49c8-88ff-c38ca7ee7d07 req-0c768ee4-9c82-4c2d-8081-54c6668919ed service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Received unexpected event network-vif-plugged-fee95532-9ed0-41e0-8bad-6b789543939a for instance with vm_state building and task_state spawning.
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464863.8939528, f50d948b-6955-4c9e-afa8-1a513ba1e715 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:23 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] VM Resumed (Lifecycle Event)
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:23 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Instance spawned successfully.
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:23 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:34:23 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464863.899722, f50d948b-6955-4c9e-afa8-1a513ba1e715 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:23 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] VM Started (Lifecycle Event)
Jul 27 13:34:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:24 user nova-compute[70914]: INFO nova.compute.manager [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Took 7.65 seconds to spawn the instance on the hypervisor.
Jul 27 13:34:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:24 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:34:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a63d367-6660-4001-b5f0-013c19ebc8de tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.608s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:24 user nova-compute[70914]: INFO nova.compute.manager [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Took 9.02 seconds to build instance.
Jul 27 13:34:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1af425f2-f5e8-4bf0-8141-218c194b4506 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.148s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:25 user nova-compute[70914]: INFO nova.compute.manager [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Terminating instance
Jul 27 13:34:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:34:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-5acb54b9-5ecf-43b7-b5bc-d52712639e8d req-2543df5d-04a7-4d02-a1e4-62a934ba6c5c service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Received event network-vif-unplugged-5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5acb54b9-5ecf-43b7-b5bc-d52712639e8d req-2543df5d-04a7-4d02-a1e4-62a934ba6c5c service nova] Acquiring lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5acb54b9-5ecf-43b7-b5bc-d52712639e8d req-2543df5d-04a7-4d02-a1e4-62a934ba6c5c service nova] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5acb54b9-5ecf-43b7-b5bc-d52712639e8d req-2543df5d-04a7-4d02-a1e4-62a934ba6c5c service nova] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-5acb54b9-5ecf-43b7-b5bc-d52712639e8d req-2543df5d-04a7-4d02-a1e4-62a934ba6c5c service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] No waiting events found dispatching network-vif-unplugged-5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-5acb54b9-5ecf-43b7-b5bc-d52712639e8d req-2543df5d-04a7-4d02-a1e4-62a934ba6c5c service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Received event network-vif-unplugged-5d3e91a2-f550-459c-ba68-1188ce457d32 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:34:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Instance destroyed successfully.
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lazy-loading 'resources' on Instance uuid 4cebb814-61ed-43f8-a4ec-a15abdcd265e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1379731878',display_name='tempest-DeleteServersTestJSON-server-1379731878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1379731878',id=3,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41d1576a91244db4b06bdcdc6f9b4c53',ramdisk_id='',reservation_id='r-nuog0a3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1454261370',owner_user_name='tempest-DeleteServersTestJSON-1454261370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:32:37Z,user_data=None,user_id='33282a3585b84222b077b7e6e4743432',uuid=4cebb814-61ed-43f8-a4ec-a15abdcd265e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d3e91a2-f550-459c-ba68-1188ce457d32", "address": "fa:16:3e:53:ef:86", "network": {"id": "31a04dc2-c876-4f85-8c3f-66fcd7653845", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501842633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d1576a91244db4b06bdcdc6f9b4c53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3e91a2-f5", "ovs_interfaceid": "5d3e91a2-f550-459c-ba68-1188ce457d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Converting VIF {"id": "5d3e91a2-f550-459c-ba68-1188ce457d32", "address": "fa:16:3e:53:ef:86", "network": {"id": "31a04dc2-c876-4f85-8c3f-66fcd7653845", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501842633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d1576a91244db4b06bdcdc6f9b4c53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3e91a2-f5", "ovs_interfaceid": "5d3e91a2-f550-459c-ba68-1188ce457d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=5d3e91a2-f550-459c-ba68-1188ce457d32,network=Network(31a04dc2-c876-4f85-8c3f-66fcd7653845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3e91a2-f5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_vif [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=5d3e91a2-f550-459c-ba68-1188ce457d32,network=Network(31a04dc2-c876-4f85-8c3f-66fcd7653845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3e91a2-f5') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d3e91a2-f5, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:26 user nova-compute[70914]: INFO os_vif [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=5d3e91a2-f550-459c-ba68-1188ce457d32,network=Network(31a04dc2-c876-4f85-8c3f-66fcd7653845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3e91a2-f5')
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AvgUesOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:26 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5c4020-1308-4531-8650-71b7aa06aecb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:34:26 user nova-compute[70914]: No targets found.
Jul 27 13:34:26 user nova-compute[70914]: iSNS:
Jul 27 13:34:26 user nova-compute[70914]: No targets found.
Jul 27 13:34:26 user nova-compute[70914]: STATIC:
Jul 27 13:34:26 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2
Jul 27 13:34:26 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:34:26 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:34:26 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d
Jul 27 13:34:26 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:34:26 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:34:26 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634
Jul 27 13:34:26 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:34:26 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:34:26 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e
Jul 27 13:34:26 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:34:26 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:34:26 user nova-compute[70914]: FIRMWARE:
Jul 27 13:34:26 user nova-compute[70914]: No targets found.
Jul 27 13:34:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:34:26 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:34:26 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ef425c-6e36-4bab-a35c-625c39d9c6ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbda060-79de-4c9f-8baf-a144b269dce8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:26 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:26 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:26 user nova-compute[70914]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 (non-flash)
Jul 27 13:34:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:26 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:26 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:26 user nova-compute[70914]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 (non-flash)
Jul 27 13:34:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18424700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634'): ({'sde'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Removing single pathed devices sde {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deaacef-068a-45b8-a712-fa5665b559fb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[724824e6-371b-48ad-af1d-9edaa42b9140]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Flushing IO for device /dev/sde {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35e3283-b21f-41b9-8f59-6a1b565bac27]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6725c5b7-5838-4c78-a73a-d01cdd0faa92]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1892ba9-8f3d-427e-8f14-aca2440f01a3]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[932ab4a6-4afa-4807-a501-7f87d86933db]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634, portal: 172.16.0.220,3260]
Jul 27 13:34:26 user nova-compute[70914]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634, portal: 172.16.0.220,3260] successful.
Jul 27 13:34:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd44ab12-135b-42fd-9da8-f63754ad6634 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8a7927-f8c5-4456-b933-13fb554c4228]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] <== disconnect_volume: return (469ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:34:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Deleting instance files /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e_del
Jul 27 13:34:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Deletion of /opt/stack/data/nova/instances/4cebb814-61ed-43f8-a4ec-a15abdcd265e_del complete
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70914) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 27 13:34:26 user nova-compute[70914]: INFO nova.virt.libvirt.host [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] UEFI support detected
Jul 27 13:34:26 user nova-compute[70914]: INFO nova.compute.manager [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Took 1.51 seconds to destroy the instance on the hypervisor.
Jul 27 13:34:26 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:34:26 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:34:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:28 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:28 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Took 1.32 seconds to deallocate network for instance.
Jul 27 13:34:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-7a25ea71-96bf-4c88-af9d-5a578bcbcc70 req-ef30da8d-43b6-4396-a3cd-fb634efce818 service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Received event network-vif-deleted-5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-feb8d26b-0279-493b-9deb-35ddaff915d4 req-2045da08-2514-470d-a095-8f0ce63339fe service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Received event network-vif-plugged-5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-feb8d26b-0279-493b-9deb-35ddaff915d4 req-2045da08-2514-470d-a095-8f0ce63339fe service nova] Acquiring lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-feb8d26b-0279-493b-9deb-35ddaff915d4 req-2045da08-2514-470d-a095-8f0ce63339fe service nova] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-feb8d26b-0279-493b-9deb-35ddaff915d4 req-2045da08-2514-470d-a095-8f0ce63339fe service nova] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-feb8d26b-0279-493b-9deb-35ddaff915d4 req-2045da08-2514-470d-a095-8f0ce63339fe service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] No waiting events found dispatching network-vif-plugged-5d3e91a2-f550-459c-ba68-1188ce457d32 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:28 user nova-compute[70914]: WARNING nova.compute.manager [req-feb8d26b-0279-493b-9deb-35ddaff915d4 req-2045da08-2514-470d-a095-8f0ce63339fe service nova] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Received unexpected event network-vif-plugged-5d3e91a2-f550-459c-ba68-1188ce457d32 for instance with vm_state active and task_state deleting.
Jul 27 13:34:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "2f25226c-952e-482b-b2c1-77384b67bbed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:34:31 user nova-compute[70914]: INFO nova.compute.claims [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Claim successful on node user
Jul 27 13:34:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:34:31 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:34:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:34:31 user nova-compute[70914]: INFO nova.virt.block_device [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Booting with volume d782ed7b-88de-430e-af81-93eb97c7ec68 at /dev/vda
Jul 27 13:34:31 user nova-compute[70914]: DEBUG nova.policy [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9279e1abc6946bc970fa3b2b2119c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c94597dacc420abba408e3b60f4a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG os_brick.utils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b77799e-4026-46ca-a4fc-53991fb2ab05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5e2e47-462f-4a20-a34e-b0ad354a6c56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a28908-d25f-48d2-87a8-623426e54ee0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b3ca76-6f2f-45e7-9895-215415022c23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:32 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e983245b-9fc6-40de-87bd-db4969072b01]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.utils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Updating existing volume attachment record: 847ea6d6-8f9b-4657-ad0b-c35f63a3bbf2 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:34:32 user nova-compute[70914]: INFO nova.compute.manager [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Took 4.07 seconds to detach 1 volumes for instance.
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzyovJCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:32 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:32 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:32 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc91ebd-7517-409a-9a5b-b54244dc498b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:34:32 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f07d095-11c4-4125-93d0-68b97873b2cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4] added
Jul 27 13:34:32 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Successfully created port: ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f969a7-2b59-4a62-b142-8ed967eed870]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[152dcf17-1a2f-44d1-b6fa-471c8067a3ef]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nzyovJCx {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nzyovJCx" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7f8ebe-fcd0-4f6f-b389-8fee1e3872fa]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nzyovJCx'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bc9e54-b24a-434b-abee-4f38aa92d2d6]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a70f59-9b09-4c47-a0c8-e780e0559591]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:32 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:32 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:32 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:32 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:32 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:32 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a07cd5-9d21-4db8-b655-ec61d83071bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260]
Jul 27 13:34:32 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260] successful.
Jul 27 13:34:32 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.531s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[863fe692-9d93-4c0d-a0a4-8901608b5d82]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1faeb0-d204-40cf-af5d-c2c374d3bcb4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:32 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:32 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:32 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:34:32 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:32 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:32 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:32 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:34:32 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:34:32 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Deleted allocations for instance 4cebb814-61ed-43f8-a4ec-a15abdcd265e
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8524d9ce-fb3e-40af-8e20-4f2e9d4ee3e5]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzyovJCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:34:33 user nova-compute[70914]: INFO nova.compute.claims [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Claim successful on node user
Jul 27 13:34:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-574d4bee-e874-4467-8e2c-1a420e4381a6 tempest-DeleteServersTestJSON-1454261370 tempest-DeleteServersTestJSON-1454261370-project-member] Lock "4cebb814-61ed-43f8-a4ec-a15abdcd265e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.815s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Successfully updated port: ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "refresh_cache-2f25226c-952e-482b-b2c1-77384b67bbed" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquired lock "refresh_cache-2f25226c-952e-482b-b2c1-77384b67bbed" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-df9ffdcd-bfa3-4d43-b802-dd20593bdcb3 req-f87a3686-f232-4e98-ad15-7b76c71f2a62 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-changed-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-df9ffdcd-bfa3-4d43-b802-dd20593bdcb3 req-f87a3686-f232-4e98-ad15-7b76c71f2a62 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Refreshing instance network info cache due to event network-changed-ae2338c5-670a-42f8-999b-8e9fdbb83378. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-df9ffdcd-bfa3-4d43-b802-dd20593bdcb3 req-f87a3686-f232-4e98-ad15-7b76c71f2a62 service nova] Acquiring lock "refresh_cache-2f25226c-952e-482b-b2c1-77384b67bbed" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:34:33 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26561333930363262', 'path': '/dev/sde'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561333930363262', 'path': '/dev/sde'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.objects.instance [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Updating instance_info_cache with network_info: [{"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Releasing lock "refresh_cache-2f25226c-952e-482b-b2c1-77384b67bbed" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Instance network_info: |[{"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-df9ffdcd-bfa3-4d43-b802-dd20593bdcb3 req-f87a3686-f232-4e98-ad15-7b76c71f2a62 service nova] Acquired lock "refresh_cache-2f25226c-952e-482b-b2c1-77384b67bbed" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.network.neutron [req-df9ffdcd-bfa3-4d43-b802-dd20593bdcb3 req-f87a3686-f232-4e98-ad15-7b76c71f2a62 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Refreshing network info cache for port ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.policy [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '582160dde2714d8b92aab6f64feeeabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29c9301c3b0454bbe8dcea3be232d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:34:34 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Creating image(s)
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "/opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "/opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "/opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:34:34 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:34:34 user nova-compute[70914]:   <source dev="/dev/sde"/>
Jul 27 13:34:34 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:34:34 user nova-compute[70914]:   <serial>216beadf-a53f-4a8f-afbd-87ee5dea9fb4</serial>
Jul 27 13:34:34 user nova-compute[70914]: </disk>
Jul 27 13:34:34 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.178s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.179s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk 1073741824" returned: 0 in 0.054s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.network.neutron [req-df9ffdcd-bfa3-4d43-b802-dd20593bdcb3 req-f87a3686-f232-4e98-ad15-7b76c71f2a62 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Updated VIF entry in instance network info cache for port ae2338c5-670a-42f8-999b-8e9fdbb83378. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.network.neutron [req-df9ffdcd-bfa3-4d43-b802-dd20593bdcb3 req-f87a3686-f232-4e98-ad15-7b76c71f2a62 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Updating instance_info_cache with network_info: [{"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.173s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-df9ffdcd-bfa3-4d43-b802-dd20593bdcb3 req-f87a3686-f232-4e98-ad15-7b76c71f2a62 service nova] Releasing lock "refresh_cache-2f25226c-952e-482b-b2c1-77384b67bbed" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Cannot resize image /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'migration_context' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No VIF found with MAC fa:16:3e:a7:0c:e4, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Ensure instance console log exists: /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:34 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Successfully created port: 57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-34070382-f30d-451f-81ed-d5d3079adb47 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.115s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4601e46f-4ac3-4dba-a537-59417e1df366 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4601e46f-4ac3-4dba-a537-59417e1df366 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4601e46f-4ac3-4dba-a537-59417e1df366 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4601e46f-4ac3-4dba-a537-59417e1df366 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70914) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4601e46f-4ac3-4dba-a537-59417e1df366 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Successfully updated port: 57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "refresh_cache-72a9344d-135a-4283-b42e-cf0e5fb4bc75" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquired lock "refresh_cache-72a9344d-135a-4283-b42e-cf0e5fb4bc75" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-20210174-2c2a-4241-b13d-9cf673e2f142 req-449e0e1c-5927-42e3-9eae-a35175feac19 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received event network-changed-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-20210174-2c2a-4241-b13d-9cf673e2f142 req-449e0e1c-5927-42e3-9eae-a35175feac19 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Refreshing instance network info cache due to event network-changed-57f3731c-b1cc-416d-b717-2fdff9bac71c. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-20210174-2c2a-4241-b13d-9cf673e2f142 req-449e0e1c-5927-42e3-9eae-a35175feac19 service nova] Acquiring lock "refresh_cache-72a9344d-135a-4283-b42e-cf0e5fb4bc75" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-95c324c8-0438-4948-bc99-d0d710ec76fd req-ff962891-8c31-487c-9360-0d290c79bee1 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-unplugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-95c324c8-0438-4948-bc99-d0d710ec76fd req-ff962891-8c31-487c-9360-0d290c79bee1 service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-95c324c8-0438-4948-bc99-d0d710ec76fd req-ff962891-8c31-487c-9360-0d290c79bee1 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-95c324c8-0438-4948-bc99-d0d710ec76fd req-ff962891-8c31-487c-9360-0d290c79bee1 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-95c324c8-0438-4948-bc99-d0d710ec76fd req-ff962891-8c31-487c-9360-0d290c79bee1 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-unplugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:36 user nova-compute[70914]: WARNING nova.compute.manager [req-95c324c8-0438-4948-bc99-d0d710ec76fd req-ff962891-8c31-487c-9360-0d290c79bee1 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-unplugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state active and task_state powering-off.
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:36 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance destroyed successfully.
Jul 27 13:34:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4601e46f-4ac3-4dba-a537-59417e1df366 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4601e46f-4ac3-4dba-a537-59417e1df366 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.182s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Updating instance_info_cache with network_info: [{"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Releasing lock "refresh_cache-72a9344d-135a-4283-b42e-cf0e5fb4bc75" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Instance network_info: |[{"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-20210174-2c2a-4241-b13d-9cf673e2f142 req-449e0e1c-5927-42e3-9eae-a35175feac19 service nova] Acquired lock "refresh_cache-72a9344d-135a-4283-b42e-cf0e5fb4bc75" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.network.neutron [req-20210174-2c2a-4241-b13d-9cf673e2f142 req-449e0e1c-5927-42e3-9eae-a35175feac19 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Refreshing network info cache for port 57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Start _get_guest_xml network_info=[{"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:34:37 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:37 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-459089625',display_name='tempest-SnapshotDataIntegrityTests-server-459089625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-459089625',id=14,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUQM3ZyZJ5JshAGoRuqLjfF/7Z9EQDhrUC/FrCWK6xAJNGaimfMfFHGtCt91oSyWSPw2EI0TJD/GvwIihwpqJPUnZiTrTOqwzCuPdJhMMzmqmNHTOOJZzJfAZG5ZB40Hg==',key_name='tempest-keypair-1139849949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b29c9301c3b0454bbe8dcea3be232d26',ramdisk_id='',reservation_id='r-2iuq0gb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1084768390',owner_user_name='tempest-SnapshotDataIntegrityTests-1084768390-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='582160dde2714d8b92aab6f64feeeabd',uuid=72a9344d-135a-4283-b42e-cf0e5fb4bc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Converting VIF {"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=57f3731c-b1cc-416d-b717-2fdff9bac71c,network=Network(c53867ce-ff16-47f8-8388-ac386c047adc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f3731c-b1') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'pci_devices' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:34:37 user nova-compute[70914]:   <uuid>72a9344d-135a-4283-b42e-cf0e5fb4bc75</uuid>
Jul 27 13:34:37 user nova-compute[70914]:   <name>instance-0000000e</name>
Jul 27 13:34:37 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:34:37 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:34:37 user nova-compute[70914]:   <metadata>
Jul 27 13:34:37 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:34:37 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:34:37 user nova-compute[70914]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-459089625</nova:name>
Jul 27 13:34:37 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:34:37</nova:creationTime>
Jul 27 13:34:37 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:34:37 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:34:37 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:34:37 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:34:37 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:34:37 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:34:37 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:34:37 user nova-compute[70914]:       <nova:owner>
Jul 27 13:34:37 user nova-compute[70914]:         <nova:user uuid="582160dde2714d8b92aab6f64feeeabd">tempest-SnapshotDataIntegrityTests-1084768390-project-member</nova:user>
Jul 27 13:34:37 user nova-compute[70914]:         <nova:project uuid="b29c9301c3b0454bbe8dcea3be232d26">tempest-SnapshotDataIntegrityTests-1084768390</nova:project>
Jul 27 13:34:37 user nova-compute[70914]:       </nova:owner>
Jul 27 13:34:37 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:34:37 user nova-compute[70914]:       <nova:ports>
Jul 27 13:34:37 user nova-compute[70914]:         <nova:port uuid="57f3731c-b1cc-416d-b717-2fdff9bac71c">
Jul 27 13:34:37 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:34:37 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:37 user nova-compute[70914]:       </nova:ports>
Jul 27 13:34:37 user nova-compute[70914]:     </nova:instance>
Jul 27 13:34:37 user nova-compute[70914]:   </metadata>
Jul 27 13:34:37 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:34:37 user nova-compute[70914]:     <system>
Jul 27 13:34:37 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:34:37 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:34:37 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:34:37 user nova-compute[70914]:       <entry name="serial">72a9344d-135a-4283-b42e-cf0e5fb4bc75</entry>
Jul 27 13:34:37 user nova-compute[70914]:       <entry name="uuid">72a9344d-135a-4283-b42e-cf0e5fb4bc75</entry>
Jul 27 13:34:37 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:34:37 user nova-compute[70914]:     </system>
Jul 27 13:34:37 user nova-compute[70914]:   </sysinfo>
Jul 27 13:34:37 user nova-compute[70914]:   <os>
Jul 27 13:34:37 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:34:37 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:34:37 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:34:37 user nova-compute[70914]:   </os>
Jul 27 13:34:37 user nova-compute[70914]:   <features>
Jul 27 13:34:37 user nova-compute[70914]:     <acpi/>
Jul 27 13:34:37 user nova-compute[70914]:     <apic/>
Jul 27 13:34:37 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:34:37 user nova-compute[70914]:   </features>
Jul 27 13:34:37 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:34:37 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:34:37 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:34:37 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:34:37 user nova-compute[70914]:   </clock>
Jul 27 13:34:37 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:34:37 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:34:37 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:34:37 user nova-compute[70914]:   </cpu>
Jul 27 13:34:37 user nova-compute[70914]:   <devices>
Jul 27 13:34:37 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:34:37 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:34:37 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk"/>
Jul 27 13:34:37 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:34:37 user nova-compute[70914]:     </disk>
Jul 27 13:34:37 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:37 user nova-compute[70914]:       <mac address="fa:16:3e:a7:1a:64"/>
Jul 27 13:34:37 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:37 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:37 user nova-compute[70914]:       <target dev="tap57f3731c-b1"/>
Jul 27 13:34:37 user nova-compute[70914]:     </interface>
Jul 27 13:34:37 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:34:37 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/console.log" append="off"/>
Jul 27 13:34:37 user nova-compute[70914]:     </serial>
Jul 27 13:34:37 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:34:37 user nova-compute[70914]:     <video>
Jul 27 13:34:37 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:37 user nova-compute[70914]:     </video>
Jul 27 13:34:37 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:34:37 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:34:37 user nova-compute[70914]:     </rng>
Jul 27 13:34:37 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:34:37 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:34:37 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:34:37 user nova-compute[70914]:     </memballoon>
Jul 27 13:34:37 user nova-compute[70914]:   </devices>
Jul 27 13:34:37 user nova-compute[70914]: </domain>
Jul 27 13:34:37 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-459089625',display_name='tempest-SnapshotDataIntegrityTests-server-459089625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-459089625',id=14,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUQM3ZyZJ5JshAGoRuqLjfF/7Z9EQDhrUC/FrCWK6xAJNGaimfMfFHGtCt91oSyWSPw2EI0TJD/GvwIihwpqJPUnZiTrTOqwzCuPdJhMMzmqmNHTOOJZzJfAZG5ZB40Hg==',key_name='tempest-keypair-1139849949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b29c9301c3b0454bbe8dcea3be232d26',ramdisk_id='',reservation_id='r-2iuq0gb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1084768390',owner_user_name='tempest-SnapshotDataIntegrityTests-1084768390-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='582160dde2714d8b92aab6f64feeeabd',uuid=72a9344d-135a-4283-b42e-cf0e5fb4bc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Converting VIF {"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=57f3731c-b1cc-416d-b717-2fdff9bac71c,network=Network(c53867ce-ff16-47f8-8388-ac386c047adc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f3731c-b1') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG os_vif [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=57f3731c-b1cc-416d-b717-2fdff9bac71c,network=Network(c53867ce-ff16-47f8-8388-ac386c047adc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f3731c-b1') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57f3731c-b1, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap57f3731c-b1, col_values=(('external_ids', {'iface-id': '57f3731c-b1cc-416d-b717-2fdff9bac71c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:1a:64', 'vm-uuid': '72a9344d-135a-4283-b42e-cf0e5fb4bc75'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:37 user nova-compute[70914]: INFO os_vif [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=57f3731c-b1cc-416d-b717-2fdff9bac71c,network=Network(c53867ce-ff16-47f8-8388-ac386c047adc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f3731c-b1')
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No VIF found with MAC fa:16:3e:a7:1a:64, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.network.neutron [req-20210174-2c2a-4241-b13d-9cf673e2f142 req-449e0e1c-5927-42e3-9eae-a35175feac19 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Updated VIF entry in instance network info cache for port 57f3731c-b1cc-416d-b717-2fdff9bac71c. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG nova.network.neutron [req-20210174-2c2a-4241-b13d-9cf673e2f142 req-449e0e1c-5927-42e3-9eae-a35175feac19 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Updating instance_info_cache with network_info: [{"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-20210174-2c2a-4241-b13d-9cf673e2f142 req-449e0e1c-5927-42e3-9eae-a35175feac19 service nova] Releasing lock "refresh_cache-72a9344d-135a-4283-b42e-cf0e5fb4bc75" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-be24c073-916d-40f7-80cf-20ac7f3c5318 req-d1050cd0-3ff7-44ed-837e-86c389b4a8da service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be24c073-916d-40f7-80cf-20ac7f3c5318 req-d1050cd0-3ff7-44ed-837e-86c389b4a8da service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be24c073-916d-40f7-80cf-20ac7f3c5318 req-d1050cd0-3ff7-44ed-837e-86c389b4a8da service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be24c073-916d-40f7-80cf-20ac7f3c5318 req-d1050cd0-3ff7-44ed-837e-86c389b4a8da service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-be24c073-916d-40f7-80cf-20ac7f3c5318 req-d1050cd0-3ff7-44ed-837e-86c389b4a8da service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:38 user nova-compute[70914]: WARNING nova.compute.manager [req-be24c073-916d-40f7-80cf-20ac7f3c5318 req-d1050cd0-3ff7-44ed-837e-86c389b4a8da service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state stopped and task_state None.
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464881.282004, 72a9344d-135a-4283-b42e-cf0e5fb4bc75 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:41 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] VM Resumed (Lifecycle Event)
Jul 27 13:34:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690464866.0884008, 4cebb814-61ed-43f8-a4ec-a15abdcd265e => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:41 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] VM Stopped (Lifecycle Event)
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-dddf8e98-4cb4-4bd6-ae44-555da08e046f req-ae3f1674-5bc1-4779-8066-87c8ce4baa5a service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received event network-vif-plugged-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dddf8e98-4cb4-4bd6-ae44-555da08e046f req-ae3f1674-5bc1-4779-8066-87c8ce4baa5a service nova] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dddf8e98-4cb4-4bd6-ae44-555da08e046f req-ae3f1674-5bc1-4779-8066-87c8ce4baa5a service nova] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dddf8e98-4cb4-4bd6-ae44-555da08e046f req-ae3f1674-5bc1-4779-8066-87c8ce4baa5a service nova] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-dddf8e98-4cb4-4bd6-ae44-555da08e046f req-ae3f1674-5bc1-4779-8066-87c8ce4baa5a service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] No waiting events found dispatching network-vif-plugged-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:41 user nova-compute[70914]: WARNING nova.compute.manager [req-dddf8e98-4cb4-4bd6-ae44-555da08e046f req-ae3f1674-5bc1-4779-8066-87c8ce4baa5a service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received unexpected event network-vif-plugged-57f3731c-b1cc-416d-b717-2fdff9bac71c for instance with vm_state building and task_state spawning.
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b55bd968-f728-4037-bf19-6066b7a802dd None None] [instance: 4cebb814-61ed-43f8-a4ec-a15abdcd265e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:41 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Instance spawned successfully.
Jul 27 13:34:41 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:41 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=6609MB free_disk=25.7020263671875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:34:41 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464881.2822177, 72a9344d-135a-4283-b42e-cf0e5fb4bc75 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:41 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] VM Started (Lifecycle Event)
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:41 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-03303402-a580-4c1d-b3ba-64a89d2c0738 req-7a2497a1-b0d0-4341-8b96-d5cb9d976853 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received event network-vif-plugged-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-03303402-a580-4c1d-b3ba-64a89d2c0738 req-7a2497a1-b0d0-4341-8b96-d5cb9d976853 service nova] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-03303402-a580-4c1d-b3ba-64a89d2c0738 req-7a2497a1-b0d0-4341-8b96-d5cb9d976853 service nova] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-03303402-a580-4c1d-b3ba-64a89d2c0738 req-7a2497a1-b0d0-4341-8b96-d5cb9d976853 service nova] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-03303402-a580-4c1d-b3ba-64a89d2c0738 req-7a2497a1-b0d0-4341-8b96-d5cb9d976853 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] No waiting events found dispatching network-vif-plugged-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:41 user nova-compute[70914]: WARNING nova.compute.manager [req-03303402-a580-4c1d-b3ba-64a89d2c0738 req-7a2497a1-b0d0-4341-8b96-d5cb9d976853 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received unexpected event network-vif-plugged-57f3731c-b1cc-416d-b717-2fdff9bac71c for instance with vm_state building and task_state spawning.
Jul 27 13:34:41 user nova-compute[70914]: INFO nova.compute.manager [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Took 7.73 seconds to spawn the instance on the hypervisor.
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:34:41 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Creating image(s)
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Ensure instance console log exists: /opt/stack/data/nova/instances/2f25226c-952e-482b-b2c1-77384b67bbed/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Start _get_guest_xml network_info=[{"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '847ea6d6-8f9b-4657-ad0b-c35f63a3bbf2', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIPfQUrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f25226c-952e-482b-b2c1-77384b67bbed', 'attached_at': '', 'detached_at': '', 'volume_id': 'd782ed7b-88de-430e-af81-93eb97c7ec68', 'serial': 'd782ed7b-88de-430e-af81-93eb97c7ec68'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:34:41 user nova-compute[70914]: INFO nova.compute.manager [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Took 8.92 seconds to build instance.
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 38108984-8bd8-49b6-9111-33c084a5a16a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance d54b6163-cc14-44d4-91c6-d306168bb875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 695f355f-022f-4040-a24f-ac41e7f40dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 74b5062f-99eb-44aa-911a-f5dd360923cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 64c90716-f424-4909-92ad-958a04f5b5a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3be64a2f-e1e6-4a27-9360-11ca508386b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance f50d948b-6955-4c9e-afa8-1a513ba1e715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 2f25226c-952e-482b-b2c1-77384b67bbed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:34:41 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:41 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8274bc1e-e2ee-4a0c-b152-8a17e1d4cfa3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.029s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIPfQUrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:41 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:41 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:41 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2de6e96-b152-4e93-9b52-0094e53a04d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:34:41 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf733ff-a416-4823-8819-e3b99be6dc53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68] added
Jul 27 13:34:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f11ac2-488c-4efb-9806-d06aedfdf173]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51908c9-a459-42ef-86bf-aecc6cfcdd50]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIPfQUrp {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIPfQUrp" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3beba2-aa05-4d09-91db-94b55649a19a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VIPfQUrp'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e1cb22-cc12-4623-bac5-87dffc21915e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff143371-c4cb-4963-9b09-475261a5e760]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:34:42 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:34:42 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[947cce2d-9258-40d0-8d5c-648caeb88547]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260]
Jul 27 13:34:42 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260] successful.
Jul 27 13:34:42 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c338820-e052-4262-aa98-8fcf106acaab]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e907d0-50fa-4413-922e-c455fe34689e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:34:42 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:34:42 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:34:42 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6594ac-4ee1-4b6b-ad6d-67b2e1603549]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIPfQUrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:34:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.671s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23530353766623730', 'path': '/dev/sdf'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530353766623730', 'path': '/dev/sdf'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2055353492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2055353492',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OojAdixfznGFq1DFKNCIKxcrjX+E9vG3RnHr9K0gfako8L+aQbe5jQFEZ9xGSZx+L1z6hfai/IJzJVF4i0/HETmmSR8l0MTYoqWjUkVS3bqQMlxlDM9T3JIc6tBeVwg==',key_name='tempest-keypair-666687196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c94597dacc420abba408e3b60f4a40',ramdisk_id='',reservation_id='r-wlsu70h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1997290170',owner_user_name='tempest-ServerActionsV293TestJSON-1997290170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:34:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9279e1abc6946bc970fa3b2b2119c67',uuid=2f25226c-952e-482b-b2c1-77384b67bbed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converting VIF {"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f25226c-952e-482b-b2c1-77384b67bbed {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:34:43 user nova-compute[70914]:   <uuid>2f25226c-952e-482b-b2c1-77384b67bbed</uuid>
Jul 27 13:34:43 user nova-compute[70914]:   <name>instance-0000000d</name>
Jul 27 13:34:43 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:34:43 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:34:43 user nova-compute[70914]:   <metadata>
Jul 27 13:34:43 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:34:43 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:34:43 user nova-compute[70914]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2055353492</nova:name>
Jul 27 13:34:43 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:34:41</nova:creationTime>
Jul 27 13:34:43 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:34:43 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:34:43 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:34:43 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:34:43 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:34:43 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:34:43 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:34:43 user nova-compute[70914]:       <nova:owner>
Jul 27 13:34:43 user nova-compute[70914]:         <nova:user uuid="a9279e1abc6946bc970fa3b2b2119c67">tempest-ServerActionsV293TestJSON-1997290170-project-member</nova:user>
Jul 27 13:34:43 user nova-compute[70914]:         <nova:project uuid="c4c94597dacc420abba408e3b60f4a40">tempest-ServerActionsV293TestJSON-1997290170</nova:project>
Jul 27 13:34:43 user nova-compute[70914]:       </nova:owner>
Jul 27 13:34:43 user nova-compute[70914]:       <nova:ports>
Jul 27 13:34:43 user nova-compute[70914]:         <nova:port uuid="ae2338c5-670a-42f8-999b-8e9fdbb83378">
Jul 27 13:34:43 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 13:34:43 user nova-compute[70914]:         </nova:port>
Jul 27 13:34:43 user nova-compute[70914]:       </nova:ports>
Jul 27 13:34:43 user nova-compute[70914]:     </nova:instance>
Jul 27 13:34:43 user nova-compute[70914]:   </metadata>
Jul 27 13:34:43 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:34:43 user nova-compute[70914]:     <system>
Jul 27 13:34:43 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:34:43 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:34:43 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:34:43 user nova-compute[70914]:       <entry name="serial">2f25226c-952e-482b-b2c1-77384b67bbed</entry>
Jul 27 13:34:43 user nova-compute[70914]:       <entry name="uuid">2f25226c-952e-482b-b2c1-77384b67bbed</entry>
Jul 27 13:34:43 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:34:43 user nova-compute[70914]:     </system>
Jul 27 13:34:43 user nova-compute[70914]:   </sysinfo>
Jul 27 13:34:43 user nova-compute[70914]:   <os>
Jul 27 13:34:43 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:34:43 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:34:43 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:34:43 user nova-compute[70914]:   </os>
Jul 27 13:34:43 user nova-compute[70914]:   <features>
Jul 27 13:34:43 user nova-compute[70914]:     <acpi/>
Jul 27 13:34:43 user nova-compute[70914]:     <apic/>
Jul 27 13:34:43 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:34:43 user nova-compute[70914]:   </features>
Jul 27 13:34:43 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:34:43 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:34:43 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:34:43 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:34:43 user nova-compute[70914]:   </clock>
Jul 27 13:34:43 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:34:43 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:34:43 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:34:43 user nova-compute[70914]:   </cpu>
Jul 27 13:34:43 user nova-compute[70914]:   <devices>
Jul 27 13:34:43 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:34:43 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:34:43 user nova-compute[70914]:       <source dev="/dev/sdf"/>
Jul 27 13:34:43 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:34:43 user nova-compute[70914]:       <serial>d782ed7b-88de-430e-af81-93eb97c7ec68</serial>
Jul 27 13:34:43 user nova-compute[70914]:     </disk>
Jul 27 13:34:43 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:34:43 user nova-compute[70914]:       <mac address="fa:16:3e:c1:0d:fd"/>
Jul 27 13:34:43 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:43 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:34:43 user nova-compute[70914]:       <target dev="tapae2338c5-67"/>
Jul 27 13:34:43 user nova-compute[70914]:     </interface>
Jul 27 13:34:43 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:34:43 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/2f25226c-952e-482b-b2c1-77384b67bbed/console.log" append="off"/>
Jul 27 13:34:43 user nova-compute[70914]:     </serial>
Jul 27 13:34:43 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:34:43 user nova-compute[70914]:     <video>
Jul 27 13:34:43 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:34:43 user nova-compute[70914]:     </video>
Jul 27 13:34:43 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:34:43 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:34:43 user nova-compute[70914]:     </rng>
Jul 27 13:34:43 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:34:43 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:34:43 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:34:43 user nova-compute[70914]:     </memballoon>
Jul 27 13:34:43 user nova-compute[70914]:   </devices>
Jul 27 13:34:43 user nova-compute[70914]: </domain>
Jul 27 13:34:43 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2055353492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2055353492',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OojAdixfznGFq1DFKNCIKxcrjX+E9vG3RnHr9K0gfako8L+aQbe5jQFEZ9xGSZx+L1z6hfai/IJzJVF4i0/HETmmSR8l0MTYoqWjUkVS3bqQMlxlDM9T3JIc6tBeVwg==',key_name='tempest-keypair-666687196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c94597dacc420abba408e3b60f4a40',ramdisk_id='',reservation_id='r-wlsu70h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1997290170',owner_user_name='tempest-ServerActionsV293TestJSON-1997290170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:34:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9279e1abc6946bc970fa3b2b2119c67',uuid=2f25226c-952e-482b-b2c1-77384b67bbed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converting VIF {"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG os_vif [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae2338c5-67, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae2338c5-67, col_values=(('external_ids', {'iface-id': 'ae2338c5-670a-42f8-999b-8e9fdbb83378', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:0d:fd', 'vm-uuid': '2f25226c-952e-482b-b2c1-77384b67bbed'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:43 user nova-compute[70914]: INFO os_vif [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67')
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] No VIF found with MAC fa:16:3e:c1:0d:fd, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Updating instance_info_cache with network_info: [{"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:34:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:34:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-3db4eeec-5fc7-4f9b-b5bb-36f3f87d3479 req-23c18bbe-5c61-4940-aa5b-d36bd0747972 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3db4eeec-5fc7-4f9b-b5bb-36f3f87d3479 req-23c18bbe-5c61-4940-aa5b-d36bd0747972 service nova] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3db4eeec-5fc7-4f9b-b5bb-36f3f87d3479 req-23c18bbe-5c61-4940-aa5b-d36bd0747972 service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3db4eeec-5fc7-4f9b-b5bb-36f3f87d3479 req-23c18bbe-5c61-4940-aa5b-d36bd0747972 service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-3db4eeec-5fc7-4f9b-b5bb-36f3f87d3479 req-23c18bbe-5c61-4940-aa5b-d36bd0747972 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] No waiting events found dispatching network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:44 user nova-compute[70914]: WARNING nova.compute.manager [req-3db4eeec-5fc7-4f9b-b5bb-36f3f87d3479 req-23c18bbe-5c61-4940-aa5b-d36bd0747972 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received unexpected event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 for instance with vm_state building and task_state spawning.
Jul 27 13:34:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:46 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464886.9521394, 2f25226c-952e-482b-b2c1-77384b67bbed => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:46 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] VM Resumed (Lifecycle Event)
Jul 27 13:34:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:34:46 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:34:46 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Instance spawned successfully.
Jul 27 13:34:46 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:34:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:46 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:46 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:46 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:34:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:47 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:34:47 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464886.9575284, 2f25226c-952e-482b-b2c1-77384b67bbed => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:47 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] VM Started (Lifecycle Event)
Jul 27 13:34:47 user nova-compute[70914]: DEBUG nova.compute.manager [req-1342f0ae-c643-4cb4-be25-f15d8953da3b req-f2298418-1f2c-41a8-8b51-94c1a360dfd6 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1342f0ae-c643-4cb4-be25-f15d8953da3b req-f2298418-1f2c-41a8-8b51-94c1a360dfd6 service nova] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1342f0ae-c643-4cb4-be25-f15d8953da3b req-f2298418-1f2c-41a8-8b51-94c1a360dfd6 service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1342f0ae-c643-4cb4-be25-f15d8953da3b req-f2298418-1f2c-41a8-8b51-94c1a360dfd6 service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:47 user nova-compute[70914]: DEBUG nova.compute.manager [req-1342f0ae-c643-4cb4-be25-f15d8953da3b req-f2298418-1f2c-41a8-8b51-94c1a360dfd6 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] No waiting events found dispatching network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:47 user nova-compute[70914]: WARNING nova.compute.manager [req-1342f0ae-c643-4cb4-be25-f15d8953da3b req-f2298418-1f2c-41a8-8b51-94c1a360dfd6 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received unexpected event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 for instance with vm_state building and task_state spawning.
Jul 27 13:34:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:47 user nova-compute[70914]: INFO nova.compute.manager [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Took 5.24 seconds to spawn the instance on the hypervisor.
Jul 27 13:34:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:47 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:34:47 user nova-compute[70914]: INFO nova.compute.manager [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Took 16.13 seconds to build instance.
Jul 27 13:34:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3b70f705-ee56-43ef-b39b-742c41a96794 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "2f25226c-952e-482b-b2c1-77384b67bbed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.239s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-978fd578-706f-4629-a6db-d7e7fefffd64 req-9a93b773-4655-46b5-9bd9-1baad1eb3ef3 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received event network-changed-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-978fd578-706f-4629-a6db-d7e7fefffd64 req-9a93b773-4655-46b5-9bd9-1baad1eb3ef3 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Refreshing instance network info cache due to event network-changed-469eb9f0-10ac-4941-8605-82eba3a20489. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:34:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-978fd578-706f-4629-a6db-d7e7fefffd64 req-9a93b773-4655-46b5-9bd9-1baad1eb3ef3 service nova] Acquiring lock "refresh_cache-695f355f-022f-4040-a24f-ac41e7f40dff" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-978fd578-706f-4629-a6db-d7e7fefffd64 req-9a93b773-4655-46b5-9bd9-1baad1eb3ef3 service nova] Acquired lock "refresh_cache-695f355f-022f-4040-a24f-ac41e7f40dff" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:49 user nova-compute[70914]: DEBUG nova.network.neutron [req-978fd578-706f-4629-a6db-d7e7fefffd64 req-9a93b773-4655-46b5-9bd9-1baad1eb3ef3 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Refreshing network info cache for port 469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-5b594038-4b1b-47fe-bbe1-41c070c334a7 req-e7f4696e-931c-4436-9d74-b73d3e20242d service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received event network-changed-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-5b594038-4b1b-47fe-bbe1-41c070c334a7 req-e7f4696e-931c-4436-9d74-b73d3e20242d service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Refreshing instance network info cache due to event network-changed-e2e00cc5-18ce-41df-869a-8bb12c7a1d37. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5b594038-4b1b-47fe-bbe1-41c070c334a7 req-e7f4696e-931c-4436-9d74-b73d3e20242d service nova] Acquiring lock "refresh_cache-64c90716-f424-4909-92ad-958a04f5b5a1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5b594038-4b1b-47fe-bbe1-41c070c334a7 req-e7f4696e-931c-4436-9d74-b73d3e20242d service nova] Acquired lock "refresh_cache-64c90716-f424-4909-92ad-958a04f5b5a1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG nova.network.neutron [req-5b594038-4b1b-47fe-bbe1-41c070c334a7 req-e7f4696e-931c-4436-9d74-b73d3e20242d service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Refreshing network info cache for port e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG nova.network.neutron [req-978fd578-706f-4629-a6db-d7e7fefffd64 req-9a93b773-4655-46b5-9bd9-1baad1eb3ef3 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Updated VIF entry in instance network info cache for port 469eb9f0-10ac-4941-8605-82eba3a20489. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG nova.network.neutron [req-978fd578-706f-4629-a6db-d7e7fefffd64 req-9a93b773-4655-46b5-9bd9-1baad1eb3ef3 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Updating instance_info_cache with network_info: [{"id": "469eb9f0-10ac-4941-8605-82eba3a20489", "address": "fa:16:3e:79:dd:84", "network": {"id": "c0aec8c2-7987-4c39-b429-f2d0344fb020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-678011263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb1d25b436a428cbced14f94a4316d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469eb9f0-10", "ovs_interfaceid": "469eb9f0-10ac-4941-8605-82eba3a20489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-978fd578-706f-4629-a6db-d7e7fefffd64 req-9a93b773-4655-46b5-9bd9-1baad1eb3ef3 service nova] Releasing lock "refresh_cache-695f355f-022f-4040-a24f-ac41e7f40dff" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lazy-loading 'flavor' on Instance uuid 64c90716-f424-4909-92ad-958a04f5b5a1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:50 user nova-compute[70914]: INFO nova.compute.manager [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Attaching volume a4bc8d2e-d623-4cd6-9ec2-0036933414dd to /dev/vdb
Jul 27 13:34:50 user nova-compute[70914]: DEBUG os_brick.utils [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[44217b48-2bea-4cac-b135-5f57926989ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG nova.network.neutron [req-5b594038-4b1b-47fe-bbe1-41c070c334a7 req-e7f4696e-931c-4436-9d74-b73d3e20242d service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Updated VIF entry in instance network info cache for port e2e00cc5-18ce-41df-869a-8bb12c7a1d37. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG nova.network.neutron [req-5b594038-4b1b-47fe-bbe1-41c070c334a7 req-e7f4696e-931c-4436-9d74-b73d3e20242d service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Updating instance_info_cache with network_info: [{"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb47fe0-09e9-4e2b-b201-bf43f48566be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5b594038-4b1b-47fe-bbe1-41c070c334a7 req-e7f4696e-931c-4436-9d74-b73d3e20242d service nova] Releasing lock "refresh_cache-64c90716-f424-4909-92ad-958a04f5b5a1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a005a0-152d-4abd-9901-f1a79c902a38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d755ccd-be4a-4c85-a996-6b516ecaddd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:50 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:34:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a72f1c8-f932-4dfe-8fb8-409cc39d41bc]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG os_brick.utils [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:50 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Updating existing volume attachment record: 751bb1a2-24ff-4225-a434-31924849f798 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "interface-74b5062f-99eb-44aa-911a-f5dd360923cb-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "interface-74b5062f-99eb-44aa-911a-f5dd360923cb-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lazy-loading 'flavor' on Instance uuid 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-e1f341ce-b17b-4b14-80bb-d40f87bdc476 req-173d7d61-9cd2-45c5-9614-bc5f90d3fde5 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-changed-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-e1f341ce-b17b-4b14-80bb-d40f87bdc476 req-173d7d61-9cd2-45c5-9614-bc5f90d3fde5 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Refreshing instance network info cache due to event network-changed-9e24abbc-7b7d-4353-be75-303948818880. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e1f341ce-b17b-4b14-80bb-d40f87bdc476 req-173d7d61-9cd2-45c5-9614-bc5f90d3fde5 service nova] Acquiring lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e1f341ce-b17b-4b14-80bb-d40f87bdc476 req-173d7d61-9cd2-45c5-9614-bc5f90d3fde5 service nova] Acquired lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-e1f341ce-b17b-4b14-80bb-d40f87bdc476 req-173d7d61-9cd2-45c5-9614-bc5f90d3fde5 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Refreshing network info cache for port 9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690464876.7752717, bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:34:51 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] VM Stopped (Lifecycle Event)
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-91ee402d-decd-4a05-ab99-ca3fde8e0b33 None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-91ee402d-decd-4a05-ab99-ca3fde8e0b33 None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lazy-loading 'pci_requests' on Instance uuid 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-e1f341ce-b17b-4b14-80bb-d40f87bdc476 req-173d7d61-9cd2-45c5-9614-bc5f90d3fde5 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updated VIF entry in instance network info cache for port 9e24abbc-7b7d-4353-be75-303948818880. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:34:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-e1f341ce-b17b-4b14-80bb-d40f87bdc476 req-173d7d61-9cd2-45c5-9614-bc5f90d3fde5 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updating instance_info_cache with network_info: [{"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e1f341ce-b17b-4b14-80bb-d40f87bdc476 req-173d7d61-9cd2-45c5-9614-bc5f90d3fde5 service nova] Releasing lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "695f355f-022f-4040-a24f-ac41e7f40dff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lazy-loading 'flavor' on Instance uuid 695f355f-022f-4040-a24f-ac41e7f40dff {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG nova.policy [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7831e5cefa7142c0a1ff99f0fcba6d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076bc6cb188749f29bd33e8d72fd5d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "695f355f-022f-4040-a24f-ac41e7f40dff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:52 user nova-compute[70914]: INFO nova.compute.manager [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Attaching volume a471a150-98e9-47a8-bf70-d2fb320e1711 to /dev/sdc
Jul 27 13:34:52 user nova-compute[70914]: DEBUG os_brick.utils [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63464ce-5748-4098-83d6-c1816e5ee57c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3cd507-7a13-4498-818b-6b41bf740526]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad16d4c2-bafd-4636-88fa-2b6134678af5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f42401-ecfb-4c77-97a6-51d0c7b68ea9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:52 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:34:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baa9d8d-a191-45c7-b564-e4d244224c7f]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG os_brick.utils [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Updating existing volume attachment record: c1e09854-4e80-44d5-968d-64619c1d0771 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:34:52 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Successfully created port: 89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:34:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Successfully updated port: 89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:34:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquired lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:34:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-1aabc6f2-fb00-4720-b3ec-48be9b97a5b5 req-e43fdfc1-7a9b-4b66-b527-dae1890399bb service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-changed-89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-1aabc6f2-fb00-4720-b3ec-48be9b97a5b5 req-e43fdfc1-7a9b-4b66-b527-dae1890399bb service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Refreshing instance network info cache due to event network-changed-89acdde9-8980-4901-99a5-b0e599b13df4. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:34:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1aabc6f2-fb00-4720-b3ec-48be9b97a5b5 req-e43fdfc1-7a9b-4b66-b527-dae1890399bb service nova] Acquiring lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:34:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updating instance_info_cache with network_info: [{"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89acdde9-8980-4901-99a5-b0e599b13df4", "address": "fa:16:3e:e0:c7:a7", "network": {"id": "cc7f83db-c2fb-4141-a474-eda265fa494d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1456278886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89acdde9-89", "ovs_interfaceid": "89acdde9-8980-4901-99a5-b0e599b13df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Releasing lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1aabc6f2-fb00-4720-b3ec-48be9b97a5b5 req-e43fdfc1-7a9b-4b66-b527-dae1890399bb service nova] Acquired lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.network.neutron [req-1aabc6f2-fb00-4720-b3ec-48be9b97a5b5 req-e43fdfc1-7a9b-4b66-b527-dae1890399bb service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Refreshing network info cache for port 89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686130538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686130538',id=9,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEPkG6YoBHNN1m07ICeDwsyBe3EyiCC5ZWV6mXw/+7QEA9m0AfwawXSd08u+IL5UEExXheTC9Q9XOElwPRpKRh7aBnH+il5ROUwwz9yELcy4nnvhviPGllDQupgOGxxtw==',key_name='tempest-keypair-1523997644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='076bc6cb188749f29bd33e8d72fd5d27',ramdisk_id='',reservation_id='r-4xtevblr',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1370278240',owner_user_name='tempest-TaggedAttachmentsTest-1370278240-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7831e5cefa7142c0a1ff99f0fcba6d12',uuid=74b5062f-99eb-44aa-911a-f5dd360923cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89acdde9-8980-4901-99a5-b0e599b13df4", "address": "fa:16:3e:e0:c7:a7", "network": {"id": "cc7f83db-c2fb-4141-a474-eda265fa494d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1456278886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89acdde9-89", "ovs_interfaceid": "89acdde9-8980-4901-99a5-b0e599b13df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converting VIF {"id": "89acdde9-8980-4901-99a5-b0e599b13df4", "address": "fa:16:3e:e0:c7:a7", "network": {"id": "cc7f83db-c2fb-4141-a474-eda265fa494d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1456278886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89acdde9-89", "ovs_interfaceid": "89acdde9-8980-4901-99a5-b0e599b13df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c7:a7,bridge_name='br-int',has_traffic_filtering=True,id=89acdde9-8980-4901-99a5-b0e599b13df4,network=Network(cc7f83db-c2fb-4141-a474-eda265fa494d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89acdde9-89') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG os_vif [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c7:a7,bridge_name='br-int',has_traffic_filtering=True,id=89acdde9-8980-4901-99a5-b0e599b13df4,network=Network(cc7f83db-c2fb-4141-a474-eda265fa494d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89acdde9-89') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89acdde9-89, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89acdde9-89, col_values=(('external_ids', {'iface-id': '89acdde9-8980-4901-99a5-b0e599b13df4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:c7:a7', 'vm-uuid': '74b5062f-99eb-44aa-911a-f5dd360923cb'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:55 user nova-compute[70914]: INFO os_vif [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c7:a7,bridge_name='br-int',has_traffic_filtering=True,id=89acdde9-8980-4901-99a5-b0e599b13df4,network=Network(cc7f83db-c2fb-4141-a474-eda265fa494d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89acdde9-89')
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686130538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686130538',id=9,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEPkG6YoBHNN1m07ICeDwsyBe3EyiCC5ZWV6mXw/+7QEA9m0AfwawXSd08u+IL5UEExXheTC9Q9XOElwPRpKRh7aBnH+il5ROUwwz9yELcy4nnvhviPGllDQupgOGxxtw==',key_name='tempest-keypair-1523997644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='076bc6cb188749f29bd33e8d72fd5d27',ramdisk_id='',reservation_id='r-4xtevblr',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1370278240',owner_user_name='tempest-TaggedAttachmentsTest-1370278240-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7831e5cefa7142c0a1ff99f0fcba6d12',uuid=74b5062f-99eb-44aa-911a-f5dd360923cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89acdde9-8980-4901-99a5-b0e599b13df4", "address": "fa:16:3e:e0:c7:a7", "network": {"id": "cc7f83db-c2fb-4141-a474-eda265fa494d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1456278886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89acdde9-89", "ovs_interfaceid": "89acdde9-8980-4901-99a5-b0e599b13df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converting VIF {"id": "89acdde9-8980-4901-99a5-b0e599b13df4", "address": "fa:16:3e:e0:c7:a7", "network": {"id": "cc7f83db-c2fb-4141-a474-eda265fa494d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1456278886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89acdde9-89", "ovs_interfaceid": "89acdde9-8980-4901-99a5-b0e599b13df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c7:a7,bridge_name='br-int',has_traffic_filtering=True,id=89acdde9-8980-4901-99a5-b0e599b13df4,network=Network(cc7f83db-c2fb-4141-a474-eda265fa494d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89acdde9-89') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] attach device xml: <interface type="ethernet">
Jul 27 13:34:55 user nova-compute[70914]:   <mac address="fa:16:3e:e0:c7:a7"/>
Jul 27 13:34:55 user nova-compute[70914]:   <model type="virtio"/>
Jul 27 13:34:55 user nova-compute[70914]:   <mtu size="1442"/>
Jul 27 13:34:55 user nova-compute[70914]:   <target dev="tap89acdde9-89"/>
Jul 27 13:34:55 user nova-compute[70914]: </interface>
Jul 27 13:34:55 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.network.neutron [req-1aabc6f2-fb00-4720-b3ec-48be9b97a5b5 req-e43fdfc1-7a9b-4b66-b527-dae1890399bb service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updated VIF entry in instance network info cache for port 89acdde9-8980-4901-99a5-b0e599b13df4. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.network.neutron [req-1aabc6f2-fb00-4720-b3ec-48be9b97a5b5 req-e43fdfc1-7a9b-4b66-b527-dae1890399bb service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updating instance_info_cache with network_info: [{"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89acdde9-8980-4901-99a5-b0e599b13df4", "address": "fa:16:3e:e0:c7:a7", "network": {"id": "cc7f83db-c2fb-4141-a474-eda265fa494d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1456278886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89acdde9-89", "ovs_interfaceid": "89acdde9-8980-4901-99a5-b0e599b13df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1aabc6f2-fb00-4720-b3ec-48be9b97a5b5 req-e43fdfc1-7a9b-4b66-b527-dae1890399bb service nova] Releasing lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] No BDM found with device name hda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:34:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] No VIF found with MAC fa:16:3e:27:0c:51, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:34:56 user nova-compute[70914]:   <nova:package version="0.0.0"/>
Jul 27 13:34:56 user nova-compute[70914]:   <nova:name>tempest-device-tagging-server-686130538</nova:name>
Jul 27 13:34:56 user nova-compute[70914]:   <nova:creationTime>2023-07-27 13:34:56</nova:creationTime>
Jul 27 13:34:56 user nova-compute[70914]:   <nova:flavor name="m1.tiny">
Jul 27 13:34:56 user nova-compute[70914]:     <nova:memory>512</nova:memory>
Jul 27 13:34:56 user nova-compute[70914]:     <nova:disk>1</nova:disk>
Jul 27 13:34:56 user nova-compute[70914]:     <nova:swap>0</nova:swap>
Jul 27 13:34:56 user nova-compute[70914]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:34:56 user nova-compute[70914]:     <nova:vcpus>1</nova:vcpus>
Jul 27 13:34:56 user nova-compute[70914]:   </nova:flavor>
Jul 27 13:34:56 user nova-compute[70914]:   <nova:owner>
Jul 27 13:34:56 user nova-compute[70914]:     <nova:user uuid="7831e5cefa7142c0a1ff99f0fcba6d12">tempest-TaggedAttachmentsTest-1370278240-project-member</nova:user>
Jul 27 13:34:56 user nova-compute[70914]:     <nova:project uuid="076bc6cb188749f29bd33e8d72fd5d27">tempest-TaggedAttachmentsTest-1370278240</nova:project>
Jul 27 13:34:56 user nova-compute[70914]:   </nova:owner>
Jul 27 13:34:56 user nova-compute[70914]:   <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:34:56 user nova-compute[70914]:   <nova:ports>
Jul 27 13:34:56 user nova-compute[70914]:     <nova:port uuid="9e24abbc-7b7d-4353-be75-303948818880">
Jul 27 13:34:56 user nova-compute[70914]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:34:56 user nova-compute[70914]:     </nova:port>
Jul 27 13:34:56 user nova-compute[70914]:     <nova:port uuid="89acdde9-8980-4901-99a5-b0e599b13df4">
Jul 27 13:34:56 user nova-compute[70914]:       <nova:ip type="fixed" address="10.10.10.105" ipVersion="4"/>
Jul 27 13:34:56 user nova-compute[70914]:     </nova:port>
Jul 27 13:34:56 user nova-compute[70914]:   </nova:ports>
Jul 27 13:34:56 user nova-compute[70914]: </nova:instance>
Jul 27 13:34:56 user nova-compute[70914]:  {{(pid=70914) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-b7323a89-7edb-441d-9073-b5b583cbe0df req-8b1748f3-0c1d-4e39-84e2-7e2c91f25d1a service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-plugged-89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b7323a89-7edb-441d-9073-b5b583cbe0df req-8b1748f3-0c1d-4e39-84e2-7e2c91f25d1a service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b7323a89-7edb-441d-9073-b5b583cbe0df req-8b1748f3-0c1d-4e39-84e2-7e2c91f25d1a service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b7323a89-7edb-441d-9073-b5b583cbe0df req-8b1748f3-0c1d-4e39-84e2-7e2c91f25d1a service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-b7323a89-7edb-441d-9073-b5b583cbe0df req-8b1748f3-0c1d-4e39-84e2-7e2c91f25d1a service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-plugged-89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:56 user nova-compute[70914]: WARNING nova.compute.manager [req-b7323a89-7edb-441d-9073-b5b583cbe0df req-8b1748f3-0c1d-4e39-84e2-7e2c91f25d1a service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-plugged-89acdde9-8980-4901-99a5-b0e599b13df4 for instance with vm_state active and task_state None.
Jul 27 13:34:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c88f8a73-a1c3-4b5b-be1e-8595f68b002f tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "interface-74b5062f-99eb-44aa-911a-f5dd360923cb-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.850s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lazy-loading 'flavor' on Instance uuid 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:34:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:57 user nova-compute[70914]: INFO nova.compute.manager [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Attaching volume 9a8ba4b6-84e0-4925-903c-6455db547e6a to /dev/vdb
Jul 27 13:34:57 user nova-compute[70914]: DEBUG os_brick.utils [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.039s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91e2ca9-b019-4549-8a2e-655e2ef562ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.063s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed40097-1018-4ff9-9cb0-07ce6aee5ea4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0245666d-bd92-4455-9c8f-b2f207524055]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4998c7-47d7-4e37-b7de-260e40546275]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:34:57 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:34:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[15014307-93d3-4432-b18a-45dc77877632]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG os_brick.utils [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:34:57 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updating existing volume attachment record: c4277dff-74b8-4e1a-98c6-425ad785a7bf {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:34:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-b1dd78f0-946a-4c70-8b68-eb01c35f6262 req-c99789bd-3227-4af8-87d5-ff65db70ed86 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-plugged-89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:34:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b1dd78f0-946a-4c70-8b68-eb01c35f6262 req-c99789bd-3227-4af8-87d5-ff65db70ed86 service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:34:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b1dd78f0-946a-4c70-8b68-eb01c35f6262 req-c99789bd-3227-4af8-87d5-ff65db70ed86 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:34:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b1dd78f0-946a-4c70-8b68-eb01c35f6262 req-c99789bd-3227-4af8-87d5-ff65db70ed86 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:34:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-b1dd78f0-946a-4c70-8b68-eb01c35f6262 req-c99789bd-3227-4af8-87d5-ff65db70ed86 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-plugged-89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:34:58 user nova-compute[70914]: WARNING nova.compute.manager [req-b1dd78f0-946a-4c70-8b68-eb01c35f6262 req-c99789bd-3227-4af8-87d5-ff65db70ed86 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-plugged-89acdde9-8980-4901-99a5-b0e599b13df4 for instance with vm_state active and task_state None.
Jul 27 13:34:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZPvpgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:34:59 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:59 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:34:59 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[422362b2-c70c-40fb-81ad-5d89e8495e36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:34:59 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ed3eaf-8156-4bed-bc24-33e96d157e29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd] added
Jul 27 13:34:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1173b31-a0be-43b8-ae71-f371ea3ced9b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f76b37-749a-4155-b67b-7d4ecf60de35]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcZPvpgi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcZPvpgi" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2646de5b-35e6-4842-b0b3-aa95c167fe28]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcZPvpgi'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a48ea8e-5b45-4605-869f-39d6da41fa72]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb25437-3a25-4d8a-91e4-89075656855e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e34db-1993-4f6b-a6f0-d667ad879d2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260]
Jul 27 13:34:59 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260] successful.
Jul 27 13:34:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c406f68f-6be7-4600-877b-4abb13b3371a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e91247d-a2ce-4bc4-b4f7-62aba1e68118]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:34:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:34:59 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:34:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80489a7-e252-42b4-bd9b-07eea27a72ec]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:34:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZPvpgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:35:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23031653830346430', 'path': '/dev/sdg'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031653830346430', 'path': '/dev/sdg'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:35:00 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lazy-loading 'flavor' on Instance uuid 64c90716-f424-4909-92ad-958a04f5b5a1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:35:00 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:35:00 user nova-compute[70914]:   <source dev="/dev/sdg"/>
Jul 27 13:35:00 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:35:00 user nova-compute[70914]:   <serial>a4bc8d2e-d623-4cd6-9ec2-0036933414dd</serial>
Jul 27 13:35:00 user nova-compute[70914]: </disk>
Jul 27 13:35:00 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] No VIF found with MAC fa:16:3e:db:b4:20, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oirLTAad', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:01 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:01 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:01 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a87f6fd-3d6b-4972-8b4f-c0c0039069df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:35:01 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a50efe-eab0-4945-b274-e7c1afc24dc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711] added
Jul 27 13:35:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4f505ab2-502d-4399-b494-d8a4e3f968e2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.860s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e3fa7-b05d-4f7c-afd6-adf844ff18c9]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a213f-4fc8-421f-9cf5-f91a796f910e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oirLTAad {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oirLTAad" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[874a0d9f-8643-484a-8309-c52e3227ece5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oirLTAad'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cfe468-c0d6-44be-8777-0f72f39d9ea4]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[08feaffd-09f7-47d7-aebc-b490470c2b29]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:01 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:01 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:01 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:01 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:01 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:01 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:01 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:01 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:01 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:01 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.utils [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49c0393-1999-4b31-ab95-77a26ae5e620]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f9053b-e14e-482e-8080-190b622a4102]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[392a4f9a-18ee-44f2-b56f-8a1d9565835b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3756e825-73dc-4522-8650-f6a570d33139]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:35:02 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a63b5e-d685-4dc4-80c3-20b8523414d2]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.utils [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --login" returned: 0 in 1.088s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1012f663-5888-43e3-acd8-2979d8930158]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711, portal: 172.16.0.220,3260]
Jul 27 13:35:02 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee63bf7-412e-4cb2-9707-3cd348d535dd]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa34476-82f2-4ee2-b52c-060095fce44c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)
Jul 27 13:35:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:02 user nova-compute[70914]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)
Jul 27 13:35:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.334s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7c04ac-2028-4043-95e8-642134dfa09a]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:35:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oirLTAad', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:35:02 user nova-compute[70914]: INFO nova.compute.manager [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Swapping volume a4bc8d2e-d623-4cd6-9ec2-0036933414dd for 6547714e-25e5-438e-a03d-db6554617b40
Jul 27 13:35:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.374s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] <== connect_volume: return (2375ms) {'type': 'block', 'scsi_wwn': '26333363239633265', 'path': '/dev/sdh'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333363239633265', 'path': '/dev/sdh'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:35:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:03 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lazy-loading 'flavor' on Instance uuid 695f355f-022f-4040-a24f-ac41e7f40dff {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:35:03 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:35:03 user nova-compute[70914]:   <source dev="/dev/sdh"/>
Jul 27 13:35:03 user nova-compute[70914]:   <target dev="sdc" bus="scsi"/>
Jul 27 13:35:03 user nova-compute[70914]:   <serial>a471a150-98e9-47a8-bf70-d2fb320e1711</serial>
Jul 27 13:35:03 user nova-compute[70914]:   <address type="drive" controller="0" unit="2"/>
Jul 27 13:35:03 user nova-compute[70914]: </disk>
Jul 27 13:35:03 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:35:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] No BDM found with device name sda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:35:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:35:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:35:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] No VIF found with MAC fa:16:3e:79:dd:84, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:35:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82798b4-35ad-4e13-b776-8a7289ecbe08 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.066s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "695f355f-022f-4040-a24f-ac41e7f40dff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:05 user nova-compute[70914]: INFO nova.compute.manager [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Detaching volume a471a150-98e9-47a8-bf70-d2fb320e1711
Jul 27 13:35:05 user nova-compute[70914]: INFO nova.virt.block_device [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Attempting to driver detach volume a471a150-98e9-47a8-bf70-d2fb320e1711 from mountpoint /dev/sdc
Jul 27 13:35:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Attempting to detach device sdc from instance 695f355f-022f-4040-a24f-ac41e7f40dff from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:35:05 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:35:05 user nova-compute[70914]:   <source dev="/dev/sdh"/>
Jul 27 13:35:05 user nova-compute[70914]:   <target dev="sdc" bus="scsi"/>
Jul 27 13:35:05 user nova-compute[70914]:   <serial>a471a150-98e9-47a8-bf70-d2fb320e1711</serial>
Jul 27 13:35:05 user nova-compute[70914]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 27 13:35:05 user nova-compute[70914]: </disk>
Jul 27 13:35:05 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:35:05 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Successfully detached device sdc from instance 695f355f-022f-4040-a24f-ac41e7f40dff from the persistent domain config.
Jul 27 13:35:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 695f355f-022f-4040-a24f-ac41e7f40dff from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:35:05 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:35:05 user nova-compute[70914]:   <source dev="/dev/sdh"/>
Jul 27 13:35:05 user nova-compute[70914]:   <target dev="sdc" bus="scsi"/>
Jul 27 13:35:05 user nova-compute[70914]:   <serial>a471a150-98e9-47a8-bf70-d2fb320e1711</serial>
Jul 27 13:35:05 user nova-compute[70914]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 27 13:35:05 user nova-compute[70914]: </disk>
Jul 27 13:35:05 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTmlQxAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:05 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:05 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:05 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690464905.6898475, 695f355f-022f-4040-a24f-ac41e7f40dff => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 695f355f-022f-4040-a24f-ac41e7f40dff {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:35:05 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Successfully detached device sdc from instance 695f355f-022f-4040-a24f-ac41e7f40dff from the live domain config.
Jul 27 13:35:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oirLTAad', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:05 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee5afc9-9354-4def-9531-2013bf8bb2bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:35:05 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec796610-d0f6-4c9e-b93b-5b2c75a948ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a] added
Jul 27 13:35:05 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ee456e-2e7d-4666-b1d8-be84b0e69452]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b92074-fdb0-4e68-b36a-61a0a45f1510]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTmlQxAz {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTmlQxAz" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f124864-0007-4c64-bcf5-1d0cb0aeca02]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yTmlQxAz'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8374e754-5407-48be-b2f1-9199bbf88734]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e165cb63-74b5-4fc4-be74-e9f3259adc71]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)
Jul 27 13:35:05 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:05 user nova-compute[70914]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)
Jul 27 13:35:05 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9971cc-2745-4a3d-b6bd-0bc6e0c9de6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a, portal: 172.16.0.220,3260]
Jul 27 13:35:05 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:05 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e336fbb9-dc0a-42a4-b491-bc2c73ca8245]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b769c06-8148-442f-8cf0-a3085d15d951]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)
Jul 27 13:35:06 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:06 user nova-compute[70914]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)
Jul 27 13:35:06 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0977d968-b2a9-44cb-a02e-b5a0ffe97fc6]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:35:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTmlQxAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26139336638376262', 'path': '/dev/sdi'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139336638376262', 'path': '/dev/sdi'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.384s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lazy-loading 'flavor' on Instance uuid 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5268b3f6-3ffe-409a-ac24-b764b5872f97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:35:07 user nova-compute[70914]: No targets found.
Jul 27 13:35:07 user nova-compute[70914]: iSNS:
Jul 27 13:35:07 user nova-compute[70914]: No targets found.
Jul 27 13:35:07 user nova-compute[70914]: STATIC:
Jul 27 13:35:07 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711
Jul 27 13:35:07 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:07 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:07 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:35:07 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:07 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:07 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd
Jul 27 13:35:07 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:07 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:07 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a
Jul 27 13:35:07 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:07 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:07 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2
Jul 27 13:35:07 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:07 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:07 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d
Jul 27 13:35:07 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:07 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:07 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e
Jul 27 13:35:07 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:07 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:07 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:35:07 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:07 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:07 user nova-compute[70914]: FIRMWARE:
Jul 27 13:35:07 user nova-compute[70914]: No targets found.
Jul 27 13:35:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:35:07 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:35:07 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:35:07 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:35:07 user nova-compute[70914]:   <source dev="/dev/sdi"/>
Jul 27 13:35:07 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:35:07 user nova-compute[70914]:   <serial>9a8ba4b6-84e0-4925-903c-6455db547e6a</serial>
Jul 27 13:35:07 user nova-compute[70914]: </disk>
Jul 27 13:35:07 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a7c453-a14c-4bad-87be-2b2e8a0cae24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e56b61-2f42-46ea-b3b4-15fc1e5e9df3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)
Jul 27 13:35:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:07 user nova-compute[70914]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 (non-flash)
Jul 27 13:35:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c187b6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711'): ({'sdh'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Removing single pathed devices sdh {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[766c609c-1983-4a71-afbe-fed0bf79ebcc]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cab458-3f92-44ed-8f6f-689a7051706d]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Flushing IO for device /dev/sdh {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7080cd-e4bb-4f66-a0d1-90ecff5b5320]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f220fa34-4bc8-4334-ab6a-ddc740d5b80b]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] SCSI volumes sdh have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[29502c18-68bf-4937-97ce-802b268dc807]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc8cdf0-91df-4f05-8fdd-590dab3b8534]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711, portal: 172.16.0.220,3260]
Jul 27 13:35:07 user nova-compute[70914]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a471a150-98e9-47a8-bf70-d2fb320e1711 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c482dc3-f506-4765-8e65-e91ba8f364c4]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] <== disconnect_volume: return (1713ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] No BDM found with device name hda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] No VIF found with MAC fa:16:3e:27:0c:51, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:35:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0195720-f333-44ab-8419-71f402c86f3d tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.694s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG nova.objects.instance [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lazy-loading 'flavor' on Instance uuid 695f355f-022f-4040-a24f-ac41e7f40dff {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9accd871-7561-44b2-a5f0-9107565b0d36 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.076s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:08 user nova-compute[70914]: INFO nova.compute.manager [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Detaching volume 9a8ba4b6-84e0-4925-903c-6455db547e6a
Jul 27 13:35:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "695f355f-022f-4040-a24f-ac41e7f40dff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:08 user nova-compute[70914]: INFO nova.compute.manager [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Terminating instance
Jul 27 13:35:08 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:35:08 user nova-compute[70914]: INFO nova.virt.block_device [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Attempting to driver detach volume 9a8ba4b6-84e0-4925-903c-6455db547e6a from mountpoint /dev/vdb
Jul 27 13:35:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Attempting to detach device vdb from instance 74b5062f-99eb-44aa-911a-f5dd360923cb from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:35:08 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:35:08 user nova-compute[70914]:   <source dev="/dev/sdi"/>
Jul 27 13:35:08 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:35:08 user nova-compute[70914]:   <serial>9a8ba4b6-84e0-4925-903c-6455db547e6a</serial>
Jul 27 13:35:08 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 13:35:08 user nova-compute[70914]: </disk>
Jul 27 13:35:08 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:35:08 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Successfully detached device vdb from instance 74b5062f-99eb-44aa-911a-f5dd360923cb from the persistent domain config.
Jul 27 13:35:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 74b5062f-99eb-44aa-911a-f5dd360923cb from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:35:08 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:35:08 user nova-compute[70914]:   <source dev="/dev/sdi"/>
Jul 27 13:35:08 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:35:08 user nova-compute[70914]:   <serial>9a8ba4b6-84e0-4925-903c-6455db547e6a</serial>
Jul 27 13:35:08 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 13:35:08 user nova-compute[70914]: </disk>
Jul 27 13:35:08 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:35:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-bda89755-a4df-4394-ad40-f044a9ca2fd9 req-79da0e21-4423-4fc7-bdb6-dc1248e3349c service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received event network-vif-unplugged-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bda89755-a4df-4394-ad40-f044a9ca2fd9 req-79da0e21-4423-4fc7-bdb6-dc1248e3349c service nova] Acquiring lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bda89755-a4df-4394-ad40-f044a9ca2fd9 req-79da0e21-4423-4fc7-bdb6-dc1248e3349c service nova] Lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bda89755-a4df-4394-ad40-f044a9ca2fd9 req-79da0e21-4423-4fc7-bdb6-dc1248e3349c service nova] Lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-bda89755-a4df-4394-ad40-f044a9ca2fd9 req-79da0e21-4423-4fc7-bdb6-dc1248e3349c service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] No waiting events found dispatching network-vif-unplugged-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-bda89755-a4df-4394-ad40-f044a9ca2fd9 req-79da0e21-4423-4fc7-bdb6-dc1248e3349c service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received event network-vif-unplugged-469eb9f0-10ac-4941-8605-82eba3a20489 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690464909.3841622, 74b5062f-99eb-44aa-911a-f5dd360923cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:35:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Successfully detached device vdb from instance 74b5062f-99eb-44aa-911a-f5dd360923cb from the live domain config.
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTmlQxAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:09 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba64cf8-759b-4dd6-9fb1-5ea64f7c7da2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:35:09 user nova-compute[70914]: No targets found.
Jul 27 13:35:09 user nova-compute[70914]: iSNS:
Jul 27 13:35:09 user nova-compute[70914]: No targets found.
Jul 27 13:35:09 user nova-compute[70914]: STATIC:
Jul 27 13:35:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:35:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd
Jul 27 13:35:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a
Jul 27 13:35:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2
Jul 27 13:35:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d
Jul 27 13:35:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e
Jul 27 13:35:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:35:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:09 user nova-compute[70914]: FIRMWARE:
Jul 27 13:35:09 user nova-compute[70914]: No targets found.
Jul 27 13:35:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:35:09 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:35:09 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[350ef86b-e607-4a2a-ab1e-1c699d11c63a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a719382b-d95b-4960-9c56-90f9b66b76f8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:09 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c184255a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a'): ({'sdi'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Removing single pathed devices sdi {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b008dde2-6b28-4708-ad23-935f32cce9fa]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[73196c7d-af6c-4ed1-98ab-f6342fb8d5f2]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Flushing IO for device /dev/sdi {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3447f7-8777-4445-ba17-dfdcec9585e8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3650a4a-0fe9-4e8e-95be-30c9bea30fa4]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] SCSI volumes sdi have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f2e6f-ee44-4dd0-9a42-736b72171426]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f433fdf7-8f23-413e-bfa7-c9ad0109de0d]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a, portal: 172.16.0.220,3260]
Jul 27 13:35:09 user nova-compute[70914]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a8ba4b6-84e0-4925-903c-6455db547e6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ece2e1a-d2be-4c7b-985e-4bc4e1379f43]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] <== disconnect_volume: return (383ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:35:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Instance destroyed successfully.
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.objects.instance [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lazy-loading 'resources' on Instance uuid 695f355f-022f-4040-a24f-ac41e7f40dff {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1716635504',display_name='tempest-AttachSCSIVolumeTestJSON-server-1716635504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1716635504',id=8,image_ref='ab7da204-98e1-4df5-bd12-889b33928fdf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM761BzEauCPypEh+rg+WbKBiNLI7Yv3VLPFSUFazq14EcYoYq4zswd0J9Vb70UrW5Dzkmxbk9V6h/obUkNHv7gi7T2sSGrHyMTWHHJmGUeti+WtEcf1BN28HL6zE0rAzA==',key_name='tempest-keypair-198629953',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fb1d25b436a428cbced14f94a4316d4',ramdisk_id='',reservation_id='r-6qofligp',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ab7da204-98e1-4df5-bd12-889b33928fdf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2006123596',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2006123596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73cfd546f5ed4787a0683c5f57ba5544',uuid=695f355f-022f-4040-a24f-ac41e7f40dff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469eb9f0-10ac-4941-8605-82eba3a20489", "address": "fa:16:3e:79:dd:84", "network": {"id": "c0aec8c2-7987-4c39-b429-f2d0344fb020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-678011263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb1d25b436a428cbced14f94a4316d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469eb9f0-10", "ovs_interfaceid": "469eb9f0-10ac-4941-8605-82eba3a20489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Converting VIF {"id": "469eb9f0-10ac-4941-8605-82eba3a20489", "address": "fa:16:3e:79:dd:84", "network": {"id": "c0aec8c2-7987-4c39-b429-f2d0344fb020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-678011263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb1d25b436a428cbced14f94a4316d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469eb9f0-10", "ovs_interfaceid": "469eb9f0-10ac-4941-8605-82eba3a20489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:dd:84,bridge_name='br-int',has_traffic_filtering=True,id=469eb9f0-10ac-4941-8605-82eba3a20489,network=Network(c0aec8c2-7987-4c39-b429-f2d0344fb020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469eb9f0-10') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG os_vif [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:dd:84,bridge_name='br-int',has_traffic_filtering=True,id=469eb9f0-10ac-4941-8605-82eba3a20489,network=Network(c0aec8c2-7987-4c39-b429-f2d0344fb020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469eb9f0-10') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap469eb9f0-10, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:09 user nova-compute[70914]: INFO os_vif [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:dd:84,bridge_name='br-int',has_traffic_filtering=True,id=469eb9f0-10ac-4941-8605-82eba3a20489,network=Network(c0aec8c2-7987-4c39-b429-f2d0344fb020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469eb9f0-10')
Jul 27 13:35:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Deleting instance files /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff_del
Jul 27 13:35:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Deletion of /opt/stack/data/nova/instances/695f355f-022f-4040-a24f-ac41e7f40dff_del complete
Jul 27 13:35:09 user nova-compute[70914]: INFO nova.compute.manager [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Took 1.10 seconds to destroy the instance on the hypervisor.
Jul 27 13:35:09 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:35:09 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG nova.objects.instance [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lazy-loading 'flavor' on Instance uuid 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cc57a640-696b-45ce-968f-206d66c1dd62 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.079s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSatpBxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64c90716-f424-4909-92ad-958a04f5b5a1', 'attached_at': '', 'detached_at': '', 'volume_id': '6547714e-25e5-438e-a03d-db6554617b40', 'serial': '6547714e-25e5-438e-a03d-db6554617b40'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZPvpgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '64c90716-f424-4909-92ad-958a04f5b5a1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'serial'} {{(pid=70914) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSatpBxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:10 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:10 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:10 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c18f19-b4c9-4c90-a4db-ad165bb461ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:35:10 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb19bd0-051d-447b-bbb1-ad73b8b7d9af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40] added
Jul 27 13:35:10 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[207dbd4a-3297-45aa-ae8f-10370a152dfd]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[545909c7-678b-4481-a3a5-0e1b5876ed2f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LSatpBxs {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LSatpBxs" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9816c420-ac7b-4c36-937a-2310ed1cfcd6]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LSatpBxs'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "interface-74b5062f-99eb-44aa-911a-f5dd360923cb-89acdde9-8980-4901-99a5-b0e599b13df4" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "interface-74b5062f-99eb-44aa-911a-f5dd360923cb-89acdde9-8980-4901-99a5-b0e599b13df4" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7292f6-c387-40d6-8025-38f94f5cce3a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.objects.instance [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lazy-loading 'flavor' on Instance uuid 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686130538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686130538',id=9,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEPkG6YoBHNN1m07ICeDwsyBe3EyiCC5ZWV6mXw/+7QEA9m0AfwawXSd08u+IL5UEExXheTC9Q9XOElwPRpKRh7aBnH+il5ROUwwz9yELcy4nnvhviPGllDQupgOGxxtw==',key_name='tempest-keypair-1523997644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076bc6cb188749f29bd33e8d72fd5d27',ramdisk_id='',reservation_id='r-4xtevblr',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1370278240',owner_user_name='tempest-TaggedAttachmentsTest-1370278240-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7831e5cefa7142c0a1ff99f0fcba6d12',uuid=74b5062f-99eb-44aa-911a-f5dd360923cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89acdde9-8980-4901-99a5-b0e599b13df4", "address": "fa:16:3e:e0:c7:a7", "network": {"id": "cc7f83db-c2fb-4141-a474-eda265fa494d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1456278886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89acdde9-89", "ovs_interfaceid": "89acdde9-8980-4901-99a5-b0e599b13df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converting VIF {"id": "89acdde9-8980-4901-99a5-b0e599b13df4", "address": "fa:16:3e:e0:c7:a7", "network": {"id": "cc7f83db-c2fb-4141-a474-eda265fa494d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1456278886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89acdde9-89", "ovs_interfaceid": "89acdde9-8980-4901-99a5-b0e599b13df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c7:a7,bridge_name='br-int',has_traffic_filtering=True,id=89acdde9-8980-4901-99a5-b0e599b13df4,network=Network(cc7f83db-c2fb-4141-a474-eda265fa494d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89acdde9-89') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad76f30-c5fc-46be-b2b2-7447c1009722]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:11 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:11 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:c7:a7"/><model type="virtio"/><mtu size="1442"/><target dev="tap89acdde9-89"/></interface> {{(pid=70914) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:c7:a7"/><model type="virtio"/><mtu size="1442"/><target dev="tap89acdde9-89"/></interface> {{(pid=70914) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Attempting to detach device tap89acdde9-89 from instance 74b5062f-99eb-44aa-911a-f5dd360923cb from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] detach device xml: <interface type="ethernet">
Jul 27 13:35:11 user nova-compute[70914]:   <mac address="fa:16:3e:e0:c7:a7"/>
Jul 27 13:35:11 user nova-compute[70914]:   <model type="virtio"/>
Jul 27 13:35:11 user nova-compute[70914]:   <mtu size="1442"/>
Jul 27 13:35:11 user nova-compute[70914]:   <target dev="tap89acdde9-89"/>
Jul 27 13:35:11 user nova-compute[70914]: </interface>
Jul 27 13:35:11 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:c7:a7"/><model type="virtio"/><mtu size="1442"/><target dev="tap89acdde9-89"/></interface> {{(pid=70914) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e0:c7:a7"/><model type="virtio"/><mtu size="1442"/><target dev="tap89acdde9-89"/></interface>not found in domain: <domain type='kvm' id='10'>
Jul 27 13:35:11 user nova-compute[70914]:   <name>instance-00000009</name>
Jul 27 13:35:11 user nova-compute[70914]:   <uuid>74b5062f-99eb-44aa-911a-f5dd360923cb</uuid>
Jul 27 13:35:11 user nova-compute[70914]:   <metadata>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:35:11 user nova-compute[70914]:   <nova:package version="0.0.0"/>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:name>tempest-device-tagging-server-686130538</nova:name>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:creationTime>2023-07-27 13:34:56</nova:creationTime>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:flavor name="m1.tiny">
Jul 27 13:35:11 user nova-compute[70914]:     <nova:memory>512</nova:memory>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:disk>1</nova:disk>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:swap>0</nova:swap>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:vcpus>1</nova:vcpus>
Jul 27 13:35:11 user nova-compute[70914]:   </nova:flavor>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:owner>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:user uuid="7831e5cefa7142c0a1ff99f0fcba6d12">tempest-TaggedAttachmentsTest-1370278240-project-member</nova:user>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:project uuid="076bc6cb188749f29bd33e8d72fd5d27">tempest-TaggedAttachmentsTest-1370278240</nova:project>
Jul 27 13:35:11 user nova-compute[70914]:   </nova:owner>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:ports>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:port uuid="9e24abbc-7b7d-4353-be75-303948818880">
Jul 27 13:35:11 user nova-compute[70914]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:35:11 user nova-compute[70914]:     </nova:port>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:port uuid="89acdde9-8980-4901-99a5-b0e599b13df4">
Jul 27 13:35:11 user nova-compute[70914]:       <nova:ip type="fixed" address="10.10.10.105" ipVersion="4"/>
Jul 27 13:35:11 user nova-compute[70914]:     </nova:port>
Jul 27 13:35:11 user nova-compute[70914]:   </nova:ports>
Jul 27 13:35:11 user nova-compute[70914]: </nova:instance>
Jul 27 13:35:11 user nova-compute[70914]:   </metadata>
Jul 27 13:35:11 user nova-compute[70914]:   <memory unit='KiB'>524288</memory>
Jul 27 13:35:11 user nova-compute[70914]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 13:35:11 user nova-compute[70914]:   <vcpu placement='static'>1</vcpu>
Jul 27 13:35:11 user nova-compute[70914]:   <resource>
Jul 27 13:35:11 user nova-compute[70914]:     <partition>/machine</partition>
Jul 27 13:35:11 user nova-compute[70914]:   </resource>
Jul 27 13:35:11 user nova-compute[70914]:   <sysinfo type='smbios'>
Jul 27 13:35:11 user nova-compute[70914]:     <system>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='version'>0.0.0</entry>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='serial'>74b5062f-99eb-44aa-911a-f5dd360923cb</entry>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='uuid'>74b5062f-99eb-44aa-911a-f5dd360923cb</entry>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='family'>Virtual Machine</entry>
Jul 27 13:35:11 user nova-compute[70914]:     </system>
Jul 27 13:35:11 user nova-compute[70914]:   </sysinfo>
Jul 27 13:35:11 user nova-compute[70914]:   <os>
Jul 27 13:35:11 user nova-compute[70914]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 13:35:11 user nova-compute[70914]:     <boot dev='hd'/>
Jul 27 13:35:11 user nova-compute[70914]:     <smbios mode='sysinfo'/>
Jul 27 13:35:11 user nova-compute[70914]:   </os>
Jul 27 13:35:11 user nova-compute[70914]:   <features>
Jul 27 13:35:11 user nova-compute[70914]:     <acpi/>
Jul 27 13:35:11 user nova-compute[70914]:     <apic/>
Jul 27 13:35:11 user nova-compute[70914]:     <vmcoreinfo state='on'/>
Jul 27 13:35:11 user nova-compute[70914]:   </features>
Jul 27 13:35:11 user nova-compute[70914]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 13:35:11 user nova-compute[70914]:     <model fallback='forbid'>Nehalem</model>
Jul 27 13:35:11 user nova-compute[70914]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 13:35:11 user nova-compute[70914]:     <feature policy='require' name='vme'/>
Jul 27 13:35:11 user nova-compute[70914]:     <feature policy='require' name='x2apic'/>
Jul 27 13:35:11 user nova-compute[70914]:     <feature policy='require' name='hypervisor'/>
Jul 27 13:35:11 user nova-compute[70914]:   </cpu>
Jul 27 13:35:11 user nova-compute[70914]:   <clock offset='utc'>
Jul 27 13:35:11 user nova-compute[70914]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 13:35:11 user nova-compute[70914]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 13:35:11 user nova-compute[70914]:     <timer name='hpet' present='no'/>
Jul 27 13:35:11 user nova-compute[70914]:   </clock>
Jul 27 13:35:11 user nova-compute[70914]:   <on_poweroff>destroy</on_poweroff>
Jul 27 13:35:11 user nova-compute[70914]:   <on_reboot>restart</on_reboot>
Jul 27 13:35:11 user nova-compute[70914]:   <on_crash>destroy</on_crash>
Jul 27 13:35:11 user nova-compute[70914]:   <devices>
Jul 27 13:35:11 user nova-compute[70914]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 13:35:11 user nova-compute[70914]:     <disk type='file' device='disk'>
Jul 27 13:35:11 user nova-compute[70914]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 13:35:11 user nova-compute[70914]:       <source file='/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk' index='2'/>
Jul 27 13:35:11 user nova-compute[70914]:       <backingStore type='file' index='3'>
Jul 27 13:35:11 user nova-compute[70914]:         <format type='raw'/>
Jul 27 13:35:11 user nova-compute[70914]:         <source file='/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d'/>
Jul 27 13:35:11 user nova-compute[70914]:         <backingStore/>
Jul 27 13:35:11 user nova-compute[70914]:       </backingStore>
Jul 27 13:35:11 user nova-compute[70914]:       <target dev='vda' bus='virtio'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='virtio-disk0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </disk>
Jul 27 13:35:11 user nova-compute[70914]:     <disk type='file' device='cdrom'>
Jul 27 13:35:11 user nova-compute[70914]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 13:35:11 user nova-compute[70914]:       <source file='/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk.config' index='1'/>
Jul 27 13:35:11 user nova-compute[70914]:       <backingStore/>
Jul 27 13:35:11 user nova-compute[70914]:       <target dev='hda' bus='ide'/>
Jul 27 13:35:11 user nova-compute[70914]:       <readonly/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='ide0-0-0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </disk>
Jul 27 13:35:11 user nova-compute[70914]:     <controller type='usb' index='0' model='none'>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='usb'/>
Jul 27 13:35:11 user nova-compute[70914]:     </controller>
Jul 27 13:35:11 user nova-compute[70914]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='pci.0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </controller>
Jul 27 13:35:11 user nova-compute[70914]:     <controller type='ide' index='0'>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='ide'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 13:35:11 user nova-compute[70914]:     </controller>
Jul 27 13:35:11 user nova-compute[70914]:     <interface type='ethernet'>
Jul 27 13:35:11 user nova-compute[70914]:       <mac address='fa:16:3e:27:0c:51'/>
Jul 27 13:35:11 user nova-compute[70914]:       <target dev='tap9e24abbc-7b'/>
Jul 27 13:35:11 user nova-compute[70914]:       <model type='virtio'/>
Jul 27 13:35:11 user nova-compute[70914]:       <mtu size='1442'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='net0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </interface>
Jul 27 13:35:11 user nova-compute[70914]:     <interface type='ethernet'>
Jul 27 13:35:11 user nova-compute[70914]:       <mac address='fa:16:3e:e0:c7:a7'/>
Jul 27 13:35:11 user nova-compute[70914]:       <target dev='tap89acdde9-89'/>
Jul 27 13:35:11 user nova-compute[70914]:       <model type='virtio'/>
Jul 27 13:35:11 user nova-compute[70914]:       <mtu size='1442'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='net1'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </interface>
Jul 27 13:35:11 user nova-compute[70914]:     <serial type='pty'>
Jul 27 13:35:11 user nova-compute[70914]:       <source path='/dev/pts/9'/>
Jul 27 13:35:11 user nova-compute[70914]:       <log file='/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/console.log' append='off'/>
Jul 27 13:35:11 user nova-compute[70914]:       <target type='isa-serial' port='0'>
Jul 27 13:35:11 user nova-compute[70914]:         <model name='isa-serial'/>
Jul 27 13:35:11 user nova-compute[70914]:       </target>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='serial0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </serial>
Jul 27 13:35:11 user nova-compute[70914]:     <console type='pty' tty='/dev/pts/9'>
Jul 27 13:35:11 user nova-compute[70914]:       <source path='/dev/pts/9'/>
Jul 27 13:35:11 user nova-compute[70914]:       <log file='/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/console.log' append='off'/>
Jul 27 13:35:11 user nova-compute[70914]:       <target type='serial' port='0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='serial0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </console>
Jul 27 13:35:11 user nova-compute[70914]:     <input type='mouse' bus='ps2'>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='input0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </input>
Jul 27 13:35:11 user nova-compute[70914]:     <input type='keyboard' bus='ps2'>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='input1'/>
Jul 27 13:35:11 user nova-compute[70914]:     </input>
Jul 27 13:35:11 user nova-compute[70914]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Jul 27 13:35:11 user nova-compute[70914]:       <listen type='address' address='0.0.0.0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </graphics>
Jul 27 13:35:11 user nova-compute[70914]:     <audio id='1' type='none'/>
Jul 27 13:35:11 user nova-compute[70914]:     <video>
Jul 27 13:35:11 user nova-compute[70914]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='video0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </video>
Jul 27 13:35:11 user nova-compute[70914]:     <memballoon model='virtio'>
Jul 27 13:35:11 user nova-compute[70914]:       <stats period='10'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='balloon0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </memballoon>
Jul 27 13:35:11 user nova-compute[70914]:     <rng model='virtio'>
Jul 27 13:35:11 user nova-compute[70914]:       <backend model='random'>/dev/urandom</backend>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='rng0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </rng>
Jul 27 13:35:11 user nova-compute[70914]:   </devices>
Jul 27 13:35:11 user nova-compute[70914]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 13:35:11 user nova-compute[70914]:     <label>libvirt-74b5062f-99eb-44aa-911a-f5dd360923cb</label>
Jul 27 13:35:11 user nova-compute[70914]:     <imagelabel>libvirt-74b5062f-99eb-44aa-911a-f5dd360923cb</imagelabel>
Jul 27 13:35:11 user nova-compute[70914]:   </seclabel>
Jul 27 13:35:11 user nova-compute[70914]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 13:35:11 user nova-compute[70914]:     <label>+64055:+108</label>
Jul 27 13:35:11 user nova-compute[70914]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 13:35:11 user nova-compute[70914]:   </seclabel>
Jul 27 13:35:11 user nova-compute[70914]: </domain>
Jul 27 13:35:11 user nova-compute[70914]:  {{(pid=70914) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 13:35:11 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Successfully detached device tap89acdde9-89 from instance 74b5062f-99eb-44aa-911a-f5dd360923cb from the persistent domain config.
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] (1/8): Attempting to detach device tap89acdde9-89 with device alias net1 from instance 74b5062f-99eb-44aa-911a-f5dd360923cb from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] detach device xml: <interface type="ethernet">
Jul 27 13:35:11 user nova-compute[70914]:   <mac address="fa:16:3e:e0:c7:a7"/>
Jul 27 13:35:11 user nova-compute[70914]:   <model type="virtio"/>
Jul 27 13:35:11 user nova-compute[70914]:   <mtu size="1442"/>
Jul 27 13:35:11 user nova-compute[70914]:   <target dev="tap89acdde9-89"/>
Jul 27 13:35:11 user nova-compute[70914]: </interface>
Jul 27 13:35:11 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --login" returned: 0 in 0.146s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[620b0283-fb49-4d53-b15e-3a4f3db871f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40, portal: 172.16.0.220,3260]
Jul 27 13:35:11 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:11 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5830a6c-13e1-4675-8586-f0582248ec72]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[92446892-926d-40a0-98a9-b840e3d57ec4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:11 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:11 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:11 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74810f5-1db9-44aa-a326-d6b2bdaa72bf]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSatpBxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-b8b95ec8-d000-41e5-a30a-904bcef74454 req-b24f3258-ad7d-4905-b9b6-358d17826fd6 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received event network-vif-plugged-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b8b95ec8-d000-41e5-a30a-904bcef74454 req-b24f3258-ad7d-4905-b9b6-358d17826fd6 service nova] Acquiring lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b8b95ec8-d000-41e5-a30a-904bcef74454 req-b24f3258-ad7d-4905-b9b6-358d17826fd6 service nova] Lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b8b95ec8-d000-41e5-a30a-904bcef74454 req-b24f3258-ad7d-4905-b9b6-358d17826fd6 service nova] Lock "695f355f-022f-4040-a24f-ac41e7f40dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-b8b95ec8-d000-41e5-a30a-904bcef74454 req-b24f3258-ad7d-4905-b9b6-358d17826fd6 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] No waiting events found dispatching network-vif-plugged-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:11 user nova-compute[70914]: WARNING nova.compute.manager [req-b8b95ec8-d000-41e5-a30a-904bcef74454 req-b24f3258-ad7d-4905-b9b6-358d17826fd6 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received unexpected event network-vif-plugged-469eb9f0-10ac-4941-8605-82eba3a20489 for instance with vm_state active and task_state deleting.
Jul 27 13:35:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Start waiting for the detach event from libvirt for device tap89acdde9-89 with device alias net1 for instance 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690464911.4468944, 74b5062f-99eb-44aa-911a-f5dd360923cb => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:c7:a7"/><model type="virtio"/><mtu size="1442"/><target dev="tap89acdde9-89"/></interface> {{(pid=70914) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e0:c7:a7"/><model type="virtio"/><mtu size="1442"/><target dev="tap89acdde9-89"/></interface>not found in domain: <domain type='kvm' id='10'>
Jul 27 13:35:11 user nova-compute[70914]:   <name>instance-00000009</name>
Jul 27 13:35:11 user nova-compute[70914]:   <uuid>74b5062f-99eb-44aa-911a-f5dd360923cb</uuid>
Jul 27 13:35:11 user nova-compute[70914]:   <metadata>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:35:11 user nova-compute[70914]:   <nova:package version="0.0.0"/>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:name>tempest-device-tagging-server-686130538</nova:name>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:creationTime>2023-07-27 13:34:56</nova:creationTime>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:flavor name="m1.tiny">
Jul 27 13:35:11 user nova-compute[70914]:     <nova:memory>512</nova:memory>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:disk>1</nova:disk>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:swap>0</nova:swap>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:vcpus>1</nova:vcpus>
Jul 27 13:35:11 user nova-compute[70914]:   </nova:flavor>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:owner>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:user uuid="7831e5cefa7142c0a1ff99f0fcba6d12">tempest-TaggedAttachmentsTest-1370278240-project-member</nova:user>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:project uuid="076bc6cb188749f29bd33e8d72fd5d27">tempest-TaggedAttachmentsTest-1370278240</nova:project>
Jul 27 13:35:11 user nova-compute[70914]:   </nova:owner>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:ports>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:port uuid="9e24abbc-7b7d-4353-be75-303948818880">
Jul 27 13:35:11 user nova-compute[70914]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:35:11 user nova-compute[70914]:     </nova:port>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:port uuid="89acdde9-8980-4901-99a5-b0e599b13df4">
Jul 27 13:35:11 user nova-compute[70914]:       <nova:ip type="fixed" address="10.10.10.105" ipVersion="4"/>
Jul 27 13:35:11 user nova-compute[70914]:     </nova:port>
Jul 27 13:35:11 user nova-compute[70914]:   </nova:ports>
Jul 27 13:35:11 user nova-compute[70914]: </nova:instance>
Jul 27 13:35:11 user nova-compute[70914]:   </metadata>
Jul 27 13:35:11 user nova-compute[70914]:   <memory unit='KiB'>524288</memory>
Jul 27 13:35:11 user nova-compute[70914]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 13:35:11 user nova-compute[70914]:   <vcpu placement='static'>1</vcpu>
Jul 27 13:35:11 user nova-compute[70914]:   <resource>
Jul 27 13:35:11 user nova-compute[70914]:     <partition>/machine</partition>
Jul 27 13:35:11 user nova-compute[70914]:   </resource>
Jul 27 13:35:11 user nova-compute[70914]:   <sysinfo type='smbios'>
Jul 27 13:35:11 user nova-compute[70914]:     <system>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='version'>0.0.0</entry>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='serial'>74b5062f-99eb-44aa-911a-f5dd360923cb</entry>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='uuid'>74b5062f-99eb-44aa-911a-f5dd360923cb</entry>
Jul 27 13:35:11 user nova-compute[70914]:       <entry name='family'>Virtual Machine</entry>
Jul 27 13:35:11 user nova-compute[70914]:     </system>
Jul 27 13:35:11 user nova-compute[70914]:   </sysinfo>
Jul 27 13:35:11 user nova-compute[70914]:   <os>
Jul 27 13:35:11 user nova-compute[70914]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 13:35:11 user nova-compute[70914]:     <boot dev='hd'/>
Jul 27 13:35:11 user nova-compute[70914]:     <smbios mode='sysinfo'/>
Jul 27 13:35:11 user nova-compute[70914]:   </os>
Jul 27 13:35:11 user nova-compute[70914]:   <features>
Jul 27 13:35:11 user nova-compute[70914]:     <acpi/>
Jul 27 13:35:11 user nova-compute[70914]:     <apic/>
Jul 27 13:35:11 user nova-compute[70914]:     <vmcoreinfo state='on'/>
Jul 27 13:35:11 user nova-compute[70914]:   </features>
Jul 27 13:35:11 user nova-compute[70914]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 13:35:11 user nova-compute[70914]:     <model fallback='forbid'>Nehalem</model>
Jul 27 13:35:11 user nova-compute[70914]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 13:35:11 user nova-compute[70914]:     <feature policy='require' name='vme'/>
Jul 27 13:35:11 user nova-compute[70914]:     <feature policy='require' name='x2apic'/>
Jul 27 13:35:11 user nova-compute[70914]:     <feature policy='require' name='hypervisor'/>
Jul 27 13:35:11 user nova-compute[70914]:   </cpu>
Jul 27 13:35:11 user nova-compute[70914]:   <clock offset='utc'>
Jul 27 13:35:11 user nova-compute[70914]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 13:35:11 user nova-compute[70914]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 13:35:11 user nova-compute[70914]:     <timer name='hpet' present='no'/>
Jul 27 13:35:11 user nova-compute[70914]:   </clock>
Jul 27 13:35:11 user nova-compute[70914]:   <on_poweroff>destroy</on_poweroff>
Jul 27 13:35:11 user nova-compute[70914]:   <on_reboot>restart</on_reboot>
Jul 27 13:35:11 user nova-compute[70914]:   <on_crash>destroy</on_crash>
Jul 27 13:35:11 user nova-compute[70914]:   <devices>
Jul 27 13:35:11 user nova-compute[70914]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 13:35:11 user nova-compute[70914]:     <disk type='file' device='disk'>
Jul 27 13:35:11 user nova-compute[70914]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 13:35:11 user nova-compute[70914]:       <source file='/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk' index='2'/>
Jul 27 13:35:11 user nova-compute[70914]:       <backingStore type='file' index='3'>
Jul 27 13:35:11 user nova-compute[70914]:         <format type='raw'/>
Jul 27 13:35:11 user nova-compute[70914]:         <source file='/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d'/>
Jul 27 13:35:11 user nova-compute[70914]:         <backingStore/>
Jul 27 13:35:11 user nova-compute[70914]:       </backingStore>
Jul 27 13:35:11 user nova-compute[70914]:       <target dev='vda' bus='virtio'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='virtio-disk0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </disk>
Jul 27 13:35:11 user nova-compute[70914]:     <disk type='file' device='cdrom'>
Jul 27 13:35:11 user nova-compute[70914]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 13:35:11 user nova-compute[70914]:       <source file='/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk.config' index='1'/>
Jul 27 13:35:11 user nova-compute[70914]:       <backingStore/>
Jul 27 13:35:11 user nova-compute[70914]:       <target dev='hda' bus='ide'/>
Jul 27 13:35:11 user nova-compute[70914]:       <readonly/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='ide0-0-0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </disk>
Jul 27 13:35:11 user nova-compute[70914]:     <controller type='usb' index='0' model='none'>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='usb'/>
Jul 27 13:35:11 user nova-compute[70914]:     </controller>
Jul 27 13:35:11 user nova-compute[70914]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='pci.0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </controller>
Jul 27 13:35:11 user nova-compute[70914]:     <controller type='ide' index='0'>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='ide'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 13:35:11 user nova-compute[70914]:     </controller>
Jul 27 13:35:11 user nova-compute[70914]:     <interface type='ethernet'>
Jul 27 13:35:11 user nova-compute[70914]:       <mac address='fa:16:3e:27:0c:51'/>
Jul 27 13:35:11 user nova-compute[70914]:       <target dev='tap9e24abbc-7b'/>
Jul 27 13:35:11 user nova-compute[70914]:       <model type='virtio'/>
Jul 27 13:35:11 user nova-compute[70914]:       <mtu size='1442'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='net0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </interface>
Jul 27 13:35:11 user nova-compute[70914]:     <serial type='pty'>
Jul 27 13:35:11 user nova-compute[70914]:       <source path='/dev/pts/9'/>
Jul 27 13:35:11 user nova-compute[70914]:       <log file='/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/console.log' append='off'/>
Jul 27 13:35:11 user nova-compute[70914]:       <target type='isa-serial' port='0'>
Jul 27 13:35:11 user nova-compute[70914]:         <model name='isa-serial'/>
Jul 27 13:35:11 user nova-compute[70914]:       </target>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='serial0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </serial>
Jul 27 13:35:11 user nova-compute[70914]:     <console type='pty' tty='/dev/pts/9'>
Jul 27 13:35:11 user nova-compute[70914]:       <source path='/dev/pts/9'/>
Jul 27 13:35:11 user nova-compute[70914]:       <log file='/opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/console.log' append='off'/>
Jul 27 13:35:11 user nova-compute[70914]:       <target type='serial' port='0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='serial0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </console>
Jul 27 13:35:11 user nova-compute[70914]:     <input type='mouse' bus='ps2'>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='input0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </input>
Jul 27 13:35:11 user nova-compute[70914]:     <input type='keyboard' bus='ps2'>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='input1'/>
Jul 27 13:35:11 user nova-compute[70914]:     </input>
Jul 27 13:35:11 user nova-compute[70914]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Jul 27 13:35:11 user nova-compute[70914]:       <listen type='address' address='0.0.0.0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </graphics>
Jul 27 13:35:11 user nova-compute[70914]:     <audio id='1' type='none'/>
Jul 27 13:35:11 user nova-compute[70914]:     <video>
Jul 27 13:35:11 user nova-compute[70914]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='video0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </video>
Jul 27 13:35:11 user nova-compute[70914]:     <memballoon model='virtio'>
Jul 27 13:35:11 user nova-compute[70914]:       <stats period='10'/>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='balloon0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </memballoon>
Jul 27 13:35:11 user nova-compute[70914]:     <rng model='virtio'>
Jul 27 13:35:11 user nova-compute[70914]:       <backend model='random'>/dev/urandom</backend>
Jul 27 13:35:11 user nova-compute[70914]:       <alias name='rng0'/>
Jul 27 13:35:11 user nova-compute[70914]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 13:35:11 user nova-compute[70914]:     </rng>
Jul 27 13:35:11 user nova-compute[70914]:   </devices>
Jul 27 13:35:11 user nova-compute[70914]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 13:35:11 user nova-compute[70914]:     <label>libvirt-74b5062f-99eb-44aa-911a-f5dd360923cb</label>
Jul 27 13:35:11 user nova-compute[70914]:     <imagelabel>libvirt-74b5062f-99eb-44aa-911a-f5dd360923cb</imagelabel>
Jul 27 13:35:11 user nova-compute[70914]:   </seclabel>
Jul 27 13:35:11 user nova-compute[70914]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 13:35:11 user nova-compute[70914]:     <label>+64055:+108</label>
Jul 27 13:35:11 user nova-compute[70914]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 13:35:11 user nova-compute[70914]:   </seclabel>
Jul 27 13:35:11 user nova-compute[70914]: </domain>
Jul 27 13:35:11 user nova-compute[70914]:  {{(pid=70914) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 13:35:11 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Successfully detached device tap89acdde9-89 from instance 74b5062f-99eb-44aa-911a-f5dd360923cb from the live domain config.
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686130538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686130538',id=9,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEPkG6YoBHNN1m07ICeDwsyBe3EyiCC5ZWV6mXw/+7QEA9m0AfwawXSd08u+IL5UEExXheTC9Q9XOElwPRpKRh7aBnH+il5ROUwwz9yELcy4nnvhviPGllDQupgOGxxtw==',key_name='tempest-keypair-1523997644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076bc6cb188749f29bd33e8d72fd5d27',ramdisk_id='',reservation_id='r-4xtevblr',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1370278240',owner_user_name='tempest-TaggedAttachmentsTest-1370278240-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7831e5cefa7142c0a1ff99f0fcba6d12',uuid=74b5062f-99eb-44aa-911a-f5dd360923cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89acdde9-8980-4901-99a5-b0e599b13df4", "address": "fa:16:3e:e0:c7:a7", "network": {"id": "cc7f83db-c2fb-4141-a474-eda265fa494d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1456278886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89acdde9-89", "ovs_interfaceid": "89acdde9-8980-4901-99a5-b0e599b13df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converting VIF {"id": "89acdde9-8980-4901-99a5-b0e599b13df4", "address": "fa:16:3e:e0:c7:a7", "network": {"id": "cc7f83db-c2fb-4141-a474-eda265fa494d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1456278886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89acdde9-89", "ovs_interfaceid": "89acdde9-8980-4901-99a5-b0e599b13df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c7:a7,bridge_name='br-int',has_traffic_filtering=True,id=89acdde9-8980-4901-99a5-b0e599b13df4,network=Network(cc7f83db-c2fb-4141-a474-eda265fa494d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89acdde9-89') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG os_vif [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c7:a7,bridge_name='br-int',has_traffic_filtering=True,id=89acdde9-8980-4901-99a5-b0e599b13df4,network=Network(cc7f83db-c2fb-4141-a474-eda265fa494d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89acdde9-89') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89acdde9-89, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-dcef290c-d6c2-48c2-8a58-a0d80200299b req-7d5f42ea-e0a7-4e50-96c1-c86af682e801 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Received event network-vif-deleted-469eb9f0-10ac-4941-8605-82eba3a20489 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:11 user nova-compute[70914]: INFO nova.compute.manager [req-dcef290c-d6c2-48c2-8a58-a0d80200299b req-7d5f42ea-e0a7-4e50-96c1-c86af682e801 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Neutron deleted interface 469eb9f0-10ac-4941-8605-82eba3a20489; detaching it from the instance and deleting it from the info cache
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.network.neutron [req-dcef290c-d6c2-48c2-8a58-a0d80200299b req-7d5f42ea-e0a7-4e50-96c1-c86af682e801 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:35:11 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Took 1.60 seconds to deallocate network for instance.
Jul 27 13:35:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:11 user nova-compute[70914]: INFO os_vif [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c7:a7,bridge_name='br-int',has_traffic_filtering=True,id=89acdde9-8980-4901-99a5-b0e599b13df4,network=Network(cc7f83db-c2fb-4141-a474-eda265fa494d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89acdde9-89')
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:35:11 user nova-compute[70914]:   <nova:package version="0.0.0"/>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:name>tempest-device-tagging-server-686130538</nova:name>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:creationTime>2023-07-27 13:35:11</nova:creationTime>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:flavor name="m1.tiny">
Jul 27 13:35:11 user nova-compute[70914]:     <nova:memory>512</nova:memory>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:disk>1</nova:disk>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:swap>0</nova:swap>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:vcpus>1</nova:vcpus>
Jul 27 13:35:11 user nova-compute[70914]:   </nova:flavor>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:owner>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:user uuid="7831e5cefa7142c0a1ff99f0fcba6d12">tempest-TaggedAttachmentsTest-1370278240-project-member</nova:user>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:project uuid="076bc6cb188749f29bd33e8d72fd5d27">tempest-TaggedAttachmentsTest-1370278240</nova:project>
Jul 27 13:35:11 user nova-compute[70914]:   </nova:owner>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:35:11 user nova-compute[70914]:   <nova:ports>
Jul 27 13:35:11 user nova-compute[70914]:     <nova:port uuid="9e24abbc-7b7d-4353-be75-303948818880">
Jul 27 13:35:11 user nova-compute[70914]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:35:11 user nova-compute[70914]:     </nova:port>
Jul 27 13:35:11 user nova-compute[70914]:   </nova:ports>
Jul 27 13:35:11 user nova-compute[70914]: </nova:instance>
Jul 27 13:35:11 user nova-compute[70914]:  {{(pid=70914) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-dcef290c-d6c2-48c2-8a58-a0d80200299b req-7d5f42ea-e0a7-4e50-96c1-c86af682e801 service nova] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Detach interface failed, port_id=469eb9f0-10ac-4941-8605-82eba3a20489, reason: Instance 695f355f-022f-4040-a24f-ac41e7f40dff could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-65925e57-6983-416c-bd13-829da739cdc6 req-9af29311-e89d-4526-b868-5af32c6ddd5c service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-unplugged-89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-65925e57-6983-416c-bd13-829da739cdc6 req-9af29311-e89d-4526-b868-5af32c6ddd5c service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-65925e57-6983-416c-bd13-829da739cdc6 req-9af29311-e89d-4526-b868-5af32c6ddd5c service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-65925e57-6983-416c-bd13-829da739cdc6 req-9af29311-e89d-4526-b868-5af32c6ddd5c service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-65925e57-6983-416c-bd13-829da739cdc6 req-9af29311-e89d-4526-b868-5af32c6ddd5c service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-unplugged-89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:11 user nova-compute[70914]: WARNING nova.compute.manager [req-65925e57-6983-416c-bd13-829da739cdc6 req-9af29311-e89d-4526-b868-5af32c6ddd5c service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-unplugged-89acdde9-8980-4901-99a5-b0e599b13df4 for instance with vm_state active and task_state None.
Jul 27 13:35:11 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:12 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Deleted allocations for instance 695f355f-022f-4040-a24f-ac41e7f40dff
Jul 27 13:35:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquired lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG nova.network.neutron [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bec1bd5d-6d98-453f-8ee9-24210bae1073 tempest-AttachSCSIVolumeTestJSON-2006123596 tempest-AttachSCSIVolumeTestJSON-2006123596-project-member] Lock "695f355f-022f-4040-a24f-ac41e7f40dff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.429s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23266643436336335', 'path': '/dev/sdh'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266643436336335', 'path': '/dev/sdh'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG nova.objects.instance [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lazy-loading 'flavor' on Instance uuid 64c90716-f424-4909-92ad-958a04f5b5a1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:12 user nova-compute[70914]: INFO nova.network.neutron [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Port 89acdde9-8980-4901-99a5-b0e599b13df4 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 27 13:35:12 user nova-compute[70914]: DEBUG nova.network.neutron [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updating instance_info_cache with network_info: [{"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Releasing lock "refresh_cache-74b5062f-99eb-44aa-911a-f5dd360923cb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-eed91091-6c60-49b8-a737-b19f0bff94f2 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "interface-74b5062f-99eb-44aa-911a-f5dd360923cb-89acdde9-8980-4901-99a5-b0e599b13df4" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.626s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:12 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 80740352 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-2df51764-bee0-4d00-9644-9973b516a787 req-cbe7ea1e-b78c-4821-80bf-274acdbb23be service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-deleted-89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-e01ed0ab-eb2b-4f98-b7b8-29d978388af3 req-eff14e75-b2a7-42cb-8bb9-0bea00f0b6a1 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-plugged-89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e01ed0ab-eb2b-4f98-b7b8-29d978388af3 req-eff14e75-b2a7-42cb-8bb9-0bea00f0b6a1 service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e01ed0ab-eb2b-4f98-b7b8-29d978388af3 req-eff14e75-b2a7-42cb-8bb9-0bea00f0b6a1 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e01ed0ab-eb2b-4f98-b7b8-29d978388af3 req-eff14e75-b2a7-42cb-8bb9-0bea00f0b6a1 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-e01ed0ab-eb2b-4f98-b7b8-29d978388af3 req-eff14e75-b2a7-42cb-8bb9-0bea00f0b6a1 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-plugged-89acdde9-8980-4901-99a5-b0e599b13df4 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:13 user nova-compute[70914]: WARNING nova.compute.manager [req-e01ed0ab-eb2b-4f98-b7b8-29d978388af3 req-eff14e75-b2a7-42cb-8bb9-0bea00f0b6a1 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-plugged-89acdde9-8980-4901-99a5-b0e599b13df4 for instance with vm_state active and task_state None.
Jul 27 13:35:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 243269632 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 407896064 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 551550976 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 732954624 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 902823936 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 1007681536 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZPvpgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:16 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d98da4-7759-42af-b2eb-f5b700707ff6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:35:16 user nova-compute[70914]: No targets found.
Jul 27 13:35:16 user nova-compute[70914]: iSNS:
Jul 27 13:35:16 user nova-compute[70914]: No targets found.
Jul 27 13:35:16 user nova-compute[70914]: STATIC:
Jul 27 13:35:16 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40
Jul 27 13:35:16 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:16 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:16 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:35:16 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:16 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:16 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd
Jul 27 13:35:16 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:16 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:16 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2
Jul 27 13:35:16 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:16 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:16 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d
Jul 27 13:35:16 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:16 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:16 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e
Jul 27 13:35:16 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:16 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:16 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:35:16 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:16 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:16 user nova-compute[70914]: FIRMWARE:
Jul 27 13:35:16 user nova-compute[70914]: No targets found.
Jul 27 13:35:16 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:35:16 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:35:16 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de9cc69-5d8b-426a-aacd-cb053e77e29d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[584886b5-de06-4379-9450-16ac00d853d6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:17 user nova-compute[70914]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c4754beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd'): ({'sdg'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Removing single pathed devices sdg {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e752ac-e11b-4b68-b695-61f7e462e509]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ba65d3-be4e-46d4-a531-cc6eeeef9389]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Flushing IO for device /dev/sdg {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[075f0c8a-85fc-474c-85a9-84286a396070]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf07d505-b520-47cf-ba38-d9f170d0101c]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] SCSI volumes sdg have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df54573-ce33-45c7-8b62-b3fb946ada5b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6f7f33-125c-4168-a865-385e918adb12]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260]
Jul 27 13:35:17 user nova-compute[70914]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df58230-99b4-4535-8fa4-18115ac8013b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] <== disconnect_volume: return (357ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSatpBxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '64c90716-f424-4909-92ad-958a04f5b5a1', 'attached_at': '', 'detached_at': '', 'volume_id': '6547714e-25e5-438e-a03d-db6554617b40', 'serial'} {{(pid=70914) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 27 13:35:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] swap_volume: removing Cinder connection for volume a4bc8d2e-d623-4cd6-9ec2-0036933414dd {{(pid=70914) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 27 13:35:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] swap_volume: Updating volume a4bc8d2e-d623-4cd6-9ec2-0036933414dd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "LSatpBxs", "auth_password": "mKAvacQ9qy0WdC", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "6547714e-25e5-438e-a03d-db6554617b40"}, "status": "reserved", "instance": "64c90716-f424-4909-92ad-958a04f5b5a1", "attached_at": "", "detached_at": "", "volume_id": "6547714e-25e5-438e-a03d-db6554617b40", "serial": "6547714e-25e5-438e-a03d-db6554617b40"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6547714e-25e5-438e-a03d-db6554617b40', 'no_device': None, 'attachment_id': 'ed3c8199-ed74-4a53-8d4b-45b76c7d4ba0'} {{(pid=70914) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 27 13:35:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b5be9eb4-9221-42b5-8e47-0623e3b14877 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.326s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG os_brick.utils [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7986090-475d-4c4b-a9e7-080f784c4b55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd5119-3934-44e1-9c57-a188396dae1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[729445e9-31ae-436f-8549-46a6bb5f5851]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8936aec0-87b6-415e-97d7-e76261a547fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:35:20 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:35:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5345ce58-a7a1-4bc9-ba64-5c73ee27e6b0]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:35:20 user nova-compute[70914]: DEBUG os_brick.utils [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:20 user nova-compute[70914]: INFO nova.compute.manager [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Swapping volume 6547714e-25e5-438e-a03d-db6554617b40 for a4bc8d2e-d623-4cd6-9ec2-0036933414dd
Jul 27 13:35:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Acquiring lock "5a33a308-264e-445b-a47e-1b62773b4d6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:35:22 user nova-compute[70914]: INFO nova.compute.claims [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Claim successful on node user
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.network.neutron [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:35:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.policy [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff78fd72dfc9498f8a6bde315cdf6902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2a357814f49dd97c2e49c42c67aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:35:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Creating image(s)
Jul 27 13:35:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "/opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "/opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.395s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk 1073741824" returned: 0 in 0.053s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Cannot resize image /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lazy-loading 'migration_context' on Instance uuid 5a33a308-264e-445b-a47e-1b62773b4d6d {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Ensure instance console log exists: /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:24 user nova-compute[70914]: DEBUG nova.network.neutron [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Successfully created port: 38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:35:24 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690464909.8088553, 695f355f-022f-4040-a24f-ac41e7f40dff => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:35:24 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] VM Stopped (Lifecycle Event)
Jul 27 13:35:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-6eece787-59d2-4cce-a409-52d14c78790c None None] [instance: 695f355f-022f-4040-a24f-ac41e7f40dff] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:35:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Successfully updated port: 38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Acquiring lock "refresh_cache-5a33a308-264e-445b-a47e-1b62773b4d6d" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Acquired lock "refresh_cache-5a33a308-264e-445b-a47e-1b62773b4d6d" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-a626f5f6-de39-48a1-be81-0e7a3feb3a54 req-f91e5c07-0b84-415c-a012-19574c9c2c3d service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Received event network-changed-38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-a626f5f6-de39-48a1-be81-0e7a3feb3a54 req-f91e5c07-0b84-415c-a012-19574c9c2c3d service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Refreshing instance network info cache due to event network-changed-38b28ca6-c959-4b13-b364-c1f7765f993f. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a626f5f6-de39-48a1-be81-0e7a3feb3a54 req-f91e5c07-0b84-415c-a012-19574c9c2c3d service nova] Acquiring lock "refresh_cache-5a33a308-264e-445b-a47e-1b62773b4d6d" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Updating instance_info_cache with network_info: [{"id": "38b28ca6-c959-4b13-b364-c1f7765f993f", "address": "fa:16:3e:e0:7c:6a", "network": {"id": "309c252c-02e4-48ff-acf8-79e0e90531e2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e48802ad24da44e8b3554f42c9496c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b28ca6-c9", "ovs_interfaceid": "38b28ca6-c959-4b13-b364-c1f7765f993f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Releasing lock "refresh_cache-5a33a308-264e-445b-a47e-1b62773b4d6d" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Instance network_info: |[{"id": "38b28ca6-c959-4b13-b364-c1f7765f993f", "address": "fa:16:3e:e0:7c:6a", "network": {"id": "309c252c-02e4-48ff-acf8-79e0e90531e2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e48802ad24da44e8b3554f42c9496c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b28ca6-c9", "ovs_interfaceid": "38b28ca6-c959-4b13-b364-c1f7765f993f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a626f5f6-de39-48a1-be81-0e7a3feb3a54 req-f91e5c07-0b84-415c-a012-19574c9c2c3d service nova] Acquired lock "refresh_cache-5a33a308-264e-445b-a47e-1b62773b4d6d" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.network.neutron [req-a626f5f6-de39-48a1-be81-0e7a3feb3a54 req-f91e5c07-0b84-415c-a012-19574c9c2c3d service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Refreshing network info cache for port 38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Start _get_guest_xml network_info=[{"id": "38b28ca6-c959-4b13-b364-c1f7765f993f", "address": "fa:16:3e:e0:7c:6a", "network": {"id": "309c252c-02e4-48ff-acf8-79e0e90531e2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e48802ad24da44e8b3554f42c9496c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b28ca6-c9", "ovs_interfaceid": "38b28ca6-c959-4b13-b364-c1f7765f993f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:35:26 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:35:26 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:35:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-643992360',display_name='tempest-VolumesNegativeTest-instance-643992360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-643992360',id=15,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f2a357814f49dd97c2e49c42c67aba',ramdisk_id='',reservation_id='r-nncbyckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1627821327',owner_user_name='tempest-VolumesNegativeTest-1627821327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:35:23Z,user_data=None,user_id='ff78fd72dfc9498f8a6bde315cdf6902',uuid=5a33a308-264e-445b-a47e-1b62773b4d6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38b28ca6-c959-4b13-b364-c1f7765f993f", "address": "fa:16:3e:e0:7c:6a", "network": {"id": "309c252c-02e4-48ff-acf8-79e0e90531e2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e48802ad24da44e8b3554f42c9496c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b28ca6-c9", "ovs_interfaceid": "38b28ca6-c959-4b13-b364-c1f7765f993f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Converting VIF {"id": "38b28ca6-c959-4b13-b364-c1f7765f993f", "address": "fa:16:3e:e0:7c:6a", "network": {"id": "309c252c-02e4-48ff-acf8-79e0e90531e2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e48802ad24da44e8b3554f42c9496c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b28ca6-c9", "ovs_interfaceid": "38b28ca6-c959-4b13-b364-c1f7765f993f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:6a,bridge_name='br-int',has_traffic_filtering=True,id=38b28ca6-c959-4b13-b364-c1f7765f993f,network=Network(309c252c-02e4-48ff-acf8-79e0e90531e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b28ca6-c9') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a33a308-264e-445b-a47e-1b62773b4d6d {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:35:26 user nova-compute[70914]:   <uuid>5a33a308-264e-445b-a47e-1b62773b4d6d</uuid>
Jul 27 13:35:26 user nova-compute[70914]:   <name>instance-0000000f</name>
Jul 27 13:35:26 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:35:26 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:35:26 user nova-compute[70914]:   <metadata>
Jul 27 13:35:26 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:35:26 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:35:26 user nova-compute[70914]:       <nova:name>tempest-VolumesNegativeTest-instance-643992360</nova:name>
Jul 27 13:35:26 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:35:26</nova:creationTime>
Jul 27 13:35:26 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:35:26 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:35:26 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:35:26 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:35:26 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:35:26 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:35:26 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:35:26 user nova-compute[70914]:       <nova:owner>
Jul 27 13:35:26 user nova-compute[70914]:         <nova:user uuid="ff78fd72dfc9498f8a6bde315cdf6902">tempest-VolumesNegativeTest-1627821327-project-member</nova:user>
Jul 27 13:35:26 user nova-compute[70914]:         <nova:project uuid="33f2a357814f49dd97c2e49c42c67aba">tempest-VolumesNegativeTest-1627821327</nova:project>
Jul 27 13:35:26 user nova-compute[70914]:       </nova:owner>
Jul 27 13:35:26 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:35:26 user nova-compute[70914]:       <nova:ports>
Jul 27 13:35:26 user nova-compute[70914]:         <nova:port uuid="38b28ca6-c959-4b13-b364-c1f7765f993f">
Jul 27 13:35:26 user nova-compute[70914]:           <nova:ip type="fixed" address="192.168.233.4" ipVersion="4"/>
Jul 27 13:35:26 user nova-compute[70914]:         </nova:port>
Jul 27 13:35:26 user nova-compute[70914]:       </nova:ports>
Jul 27 13:35:26 user nova-compute[70914]:     </nova:instance>
Jul 27 13:35:26 user nova-compute[70914]:   </metadata>
Jul 27 13:35:26 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:35:26 user nova-compute[70914]:     <system>
Jul 27 13:35:26 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:35:26 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:35:26 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:35:26 user nova-compute[70914]:       <entry name="serial">5a33a308-264e-445b-a47e-1b62773b4d6d</entry>
Jul 27 13:35:26 user nova-compute[70914]:       <entry name="uuid">5a33a308-264e-445b-a47e-1b62773b4d6d</entry>
Jul 27 13:35:26 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:35:26 user nova-compute[70914]:     </system>
Jul 27 13:35:26 user nova-compute[70914]:   </sysinfo>
Jul 27 13:35:26 user nova-compute[70914]:   <os>
Jul 27 13:35:26 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:35:26 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:35:26 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:35:26 user nova-compute[70914]:   </os>
Jul 27 13:35:26 user nova-compute[70914]:   <features>
Jul 27 13:35:26 user nova-compute[70914]:     <acpi/>
Jul 27 13:35:26 user nova-compute[70914]:     <apic/>
Jul 27 13:35:26 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:35:26 user nova-compute[70914]:   </features>
Jul 27 13:35:26 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:35:26 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:35:26 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:35:26 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:35:26 user nova-compute[70914]:   </clock>
Jul 27 13:35:26 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:35:26 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:35:26 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:35:26 user nova-compute[70914]:   </cpu>
Jul 27 13:35:26 user nova-compute[70914]:   <devices>
Jul 27 13:35:26 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:35:26 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:35:26 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk"/>
Jul 27 13:35:26 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:35:26 user nova-compute[70914]:     </disk>
Jul 27 13:35:26 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:35:26 user nova-compute[70914]:       <mac address="fa:16:3e:e0:7c:6a"/>
Jul 27 13:35:26 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:35:26 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:35:26 user nova-compute[70914]:       <target dev="tap38b28ca6-c9"/>
Jul 27 13:35:26 user nova-compute[70914]:     </interface>
Jul 27 13:35:26 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:35:26 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/console.log" append="off"/>
Jul 27 13:35:26 user nova-compute[70914]:     </serial>
Jul 27 13:35:26 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:35:26 user nova-compute[70914]:     <video>
Jul 27 13:35:26 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:35:26 user nova-compute[70914]:     </video>
Jul 27 13:35:26 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:35:26 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:35:26 user nova-compute[70914]:     </rng>
Jul 27 13:35:26 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:35:26 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:35:26 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:35:26 user nova-compute[70914]:     </memballoon>
Jul 27 13:35:26 user nova-compute[70914]:   </devices>
Jul 27 13:35:26 user nova-compute[70914]: </domain>
Jul 27 13:35:26 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:35:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-643992360',display_name='tempest-VolumesNegativeTest-instance-643992360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-643992360',id=15,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f2a357814f49dd97c2e49c42c67aba',ramdisk_id='',reservation_id='r-nncbyckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1627821327',owner_user_name='tempest-VolumesNegativeTest-1627821327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:35:23Z,user_data=None,user_id='ff78fd72dfc9498f8a6bde315cdf6902',uuid=5a33a308-264e-445b-a47e-1b62773b4d6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38b28ca6-c959-4b13-b364-c1f7765f993f", "address": "fa:16:3e:e0:7c:6a", "network": {"id": "309c252c-02e4-48ff-acf8-79e0e90531e2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e48802ad24da44e8b3554f42c9496c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b28ca6-c9", "ovs_interfaceid": "38b28ca6-c959-4b13-b364-c1f7765f993f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Converting VIF {"id": "38b28ca6-c959-4b13-b364-c1f7765f993f", "address": "fa:16:3e:e0:7c:6a", "network": {"id": "309c252c-02e4-48ff-acf8-79e0e90531e2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e48802ad24da44e8b3554f42c9496c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b28ca6-c9", "ovs_interfaceid": "38b28ca6-c959-4b13-b364-c1f7765f993f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:6a,bridge_name='br-int',has_traffic_filtering=True,id=38b28ca6-c959-4b13-b364-c1f7765f993f,network=Network(309c252c-02e4-48ff-acf8-79e0e90531e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b28ca6-c9') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG os_vif [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:6a,bridge_name='br-int',has_traffic_filtering=True,id=38b28ca6-c959-4b13-b364-c1f7765f993f,network=Network(309c252c-02e4-48ff-acf8-79e0e90531e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b28ca6-c9') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38b28ca6-c9, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38b28ca6-c9, col_values=(('external_ids', {'iface-id': '38b28ca6-c959-4b13-b364-c1f7765f993f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:7c:6a', 'vm-uuid': '5a33a308-264e-445b-a47e-1b62773b4d6d'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:26 user nova-compute[70914]: INFO os_vif [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:6a,bridge_name='br-int',has_traffic_filtering=True,id=38b28ca6-c959-4b13-b364-c1f7765f993f,network=Network(309c252c-02e4-48ff-acf8-79e0e90531e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b28ca6-c9')
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:35:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] No VIF found with MAC fa:16:3e:e0:7c:6a, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:35:27 user nova-compute[70914]: DEBUG nova.network.neutron [req-a626f5f6-de39-48a1-be81-0e7a3feb3a54 req-f91e5c07-0b84-415c-a012-19574c9c2c3d service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Updated VIF entry in instance network info cache for port 38b28ca6-c959-4b13-b364-c1f7765f993f. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:35:27 user nova-compute[70914]: DEBUG nova.network.neutron [req-a626f5f6-de39-48a1-be81-0e7a3feb3a54 req-f91e5c07-0b84-415c-a012-19574c9c2c3d service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Updating instance_info_cache with network_info: [{"id": "38b28ca6-c959-4b13-b364-c1f7765f993f", "address": "fa:16:3e:e0:7c:6a", "network": {"id": "309c252c-02e4-48ff-acf8-79e0e90531e2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e48802ad24da44e8b3554f42c9496c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b28ca6-c9", "ovs_interfaceid": "38b28ca6-c959-4b13-b364-c1f7765f993f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:35:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a626f5f6-de39-48a1-be81-0e7a3feb3a54 req-f91e5c07-0b84-415c-a012-19574c9c2c3d service nova] Releasing lock "refresh_cache-5a33a308-264e-445b-a47e-1b62773b4d6d" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZPvpgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64c90716-f424-4909-92ad-958a04f5b5a1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'serial': 'a4bc8d2e-d623-4cd6-9ec2-0036933414dd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSatpBxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '6547714e-25e5-438e-a03d-db6554617b40'}, 'status': 'reserved', 'instance': '64c90716-f424-4909-92ad-958a04f5b5a1', 'attached_at': '', 'detached_at': '', 'volume_id': '6547714e-25e5-438e-a03d-db6554617b40', 'serial'} {{(pid=70914) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZPvpgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:28 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:28 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:28 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[451e7b66-0028-4f1f-b385-d72eef6079a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:35:28 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5633dd6d-50cf-433f-bfa3-0be68aa54f37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd] added
Jul 27 13:35:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c912bae9-aca5-4069-a3f3-babc12c0f992]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43c373e-2362-4571-a64a-28a5be31027d]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcZPvpgi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcZPvpgi" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcc9013-bfeb-49aa-a475-0282d49654f9]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcZPvpgi'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[67692fc2-ab08-472d-b673-2acd9c69ef9f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe57c5a-5720-4b15-b07e-9b5d99725f20]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[da10d9a2-4acd-42cb-abfc-b5c18cf4a8d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260]
Jul 27 13:35:28 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a1f14e-c7c6-44d0-b12f-6d7aa8623d24]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f086de-32a4-46b4-82ea-90078ba9e2f9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae25c63e-f13d-437d-a080-e69a54a46416]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZPvpgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-4267b70b-4853-4939-8085-cfced6a5474f req-cff5dbf8-26b6-4b74-a316-f58cbfe82e9f service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Received event network-vif-plugged-38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4267b70b-4853-4939-8085-cfced6a5474f req-cff5dbf8-26b6-4b74-a316-f58cbfe82e9f service nova] Acquiring lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4267b70b-4853-4939-8085-cfced6a5474f req-cff5dbf8-26b6-4b74-a316-f58cbfe82e9f service nova] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4267b70b-4853-4939-8085-cfced6a5474f req-cff5dbf8-26b6-4b74-a316-f58cbfe82e9f service nova] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-4267b70b-4853-4939-8085-cfced6a5474f req-cff5dbf8-26b6-4b74-a316-f58cbfe82e9f service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] No waiting events found dispatching network-vif-plugged-38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:28 user nova-compute[70914]: WARNING nova.compute.manager [req-4267b70b-4853-4939-8085-cfced6a5474f req-cff5dbf8-26b6-4b74-a316-f58cbfe82e9f service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Received unexpected event network-vif-plugged-38b28ca6-c959-4b13-b364-c1f7765f993f for instance with vm_state building and task_state spawning.
Jul 27 13:35:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23031653830346430', 'path': '/dev/sdg'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031653830346430', 'path': '/dev/sdg'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:35:29 user nova-compute[70914]: DEBUG nova.objects.instance [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lazy-loading 'flavor' on Instance uuid 64c90716-f424-4909-92ad-958a04f5b5a1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464930.5797687, 5a33a308-264e-445b-a47e-1b62773b4d6d => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:35:30 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] VM Resumed (Lifecycle Event)
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:35:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Instance spawned successfully.
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:35:30 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464930.5890205, 5a33a308-264e-445b-a47e-1b62773b4d6d => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:35:30 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] VM Started (Lifecycle Event)
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:35:30 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:35:30 user nova-compute[70914]: INFO nova.compute.manager [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Took 7.79 seconds to spawn the instance on the hypervisor.
Jul 27 13:35:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:35:30 user nova-compute[70914]: INFO nova.compute.manager [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Took 8.78 seconds to build instance.
Jul 27 13:35:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846eb383-27a6-49a0-811c-01e9917b7f41 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.891s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-2e55e45e-fbc4-4f61-82d4-57164d7df241 req-57cca713-16b7-41a7-9788-d056cba2cefa service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-changed-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-2e55e45e-fbc4-4f61-82d4-57164d7df241 req-57cca713-16b7-41a7-9788-d056cba2cefa service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing instance network info cache due to event network-changed-ac119717-e6be-424f-9bc2-7961779c0b8a. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2e55e45e-fbc4-4f61-82d4-57164d7df241 req-57cca713-16b7-41a7-9788-d056cba2cefa service nova] Acquiring lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2e55e45e-fbc4-4f61-82d4-57164d7df241 req-57cca713-16b7-41a7-9788-d056cba2cefa service nova] Acquired lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG nova.network.neutron [req-2e55e45e-fbc4-4f61-82d4-57164d7df241 req-57cca713-16b7-41a7-9788-d056cba2cefa service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Refreshing network info cache for port ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 270532608 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-559057b4-accc-4d4a-9c9c-8018a9297538 req-cc5de900-e078-40bc-bca1-e79b48c0eef5 service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Received event network-vif-plugged-38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-559057b4-accc-4d4a-9c9c-8018a9297538 req-cc5de900-e078-40bc-bca1-e79b48c0eef5 service nova] Acquiring lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-559057b4-accc-4d4a-9c9c-8018a9297538 req-cc5de900-e078-40bc-bca1-e79b48c0eef5 service nova] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-559057b4-accc-4d4a-9c9c-8018a9297538 req-cc5de900-e078-40bc-bca1-e79b48c0eef5 service nova] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-559057b4-accc-4d4a-9c9c-8018a9297538 req-cc5de900-e078-40bc-bca1-e79b48c0eef5 service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] No waiting events found dispatching network-vif-plugged-38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:31 user nova-compute[70914]: WARNING nova.compute.manager [req-559057b4-accc-4d4a-9c9c-8018a9297538 req-cc5de900-e078-40bc-bca1-e79b48c0eef5 service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Received unexpected event network-vif-plugged-38b28ca6-c959-4b13-b364-c1f7765f993f for instance with vm_state active and task_state None.
Jul 27 13:35:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 402653184 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-2e55e45e-fbc4-4f61-82d4-57164d7df241 req-57cca713-16b7-41a7-9788-d056cba2cefa service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updated VIF entry in instance network info cache for port ac119717-e6be-424f-9bc2-7961779c0b8a. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:35:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-2e55e45e-fbc4-4f61-82d4-57164d7df241 req-57cca713-16b7-41a7-9788-d056cba2cefa service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [{"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:35:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2e55e45e-fbc4-4f61-82d4-57164d7df241 req-57cca713-16b7-41a7-9788-d056cba2cefa service nova] Releasing lock "refresh_cache-3be64a2f-e1e6-4a27-9360-11ca508386b8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:35:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 562036736 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 715128832 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 880803840 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:33 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:35:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:35:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 1037041664 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSatpBxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '6547714e-25e5-438e-a03d-db6554617b40'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:34 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d53344-1a5f-4677-b2bd-38a510f4d1b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:35:34 user nova-compute[70914]: No targets found.
Jul 27 13:35:34 user nova-compute[70914]: iSNS:
Jul 27 13:35:34 user nova-compute[70914]: No targets found.
Jul 27 13:35:34 user nova-compute[70914]: STATIC:
Jul 27 13:35:34 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40
Jul 27 13:35:34 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:34 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:34 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:35:34 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:34 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:34 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd
Jul 27 13:35:34 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:34 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:34 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2
Jul 27 13:35:34 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:34 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:34 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d
Jul 27 13:35:34 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:34 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:34 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e
Jul 27 13:35:34 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:34 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:34 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:35:34 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:34 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:34 user nova-compute[70914]: FIRMWARE:
Jul 27 13:35:34 user nova-compute[70914]: No targets found.
Jul 27 13:35:34 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:35:34 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:35:34 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7506c5f4-9fdb-4198-88d1-fdbfb6c3dfef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[602839cd-8155-4c7d-8d1e-f007c92ffb84]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:34 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:34 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:34 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c4754b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40'): ({'sdh'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Removing single pathed devices sdh {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[58669663-78ae-4e53-8081-751a704e586b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[02386ab3-db3d-4921-a78d-4f513cedb1cd]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Flushing IO for device /dev/sdh {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7484ae7-ef84-423d-9d8e-5bfc0b0eaab7]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed847e1-4332-437c-bf19-65c14028a89e]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] SCSI volumes sdh have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:34 user nova-compute[70914]: INFO nova.compute.manager [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Terminating instance
Jul 27 13:35:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbcd158-1670-4265-b391-0f6aa7ca464e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff045e0a-bf92-4661-8123-3f49a75b0c01]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40, portal: 172.16.0.220,3260]
Jul 27 13:35:34 user nova-compute[70914]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:34 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6547714e-25e5-438e-a03d-db6554617b40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[546b2e14-425c-41d4-bcc9-ae868eae37e5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] <== disconnect_volume: return (369ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZPvpgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '64c90716-f424-4909-92ad-958a04f5b5a1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'serial'} {{(pid=70914) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] swap_volume: removing Cinder connection for volume 6547714e-25e5-438e-a03d-db6554617b40 {{(pid=70914) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-8f229491-5586-4f0c-ba68-3011d53cd45d req-8236b539-f4e8-4a53-b489-a35999dad47c service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8f229491-5586-4f0c-ba68-3011d53cd45d req-8236b539-f4e8-4a53-b489-a35999dad47c service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8f229491-5586-4f0c-ba68-3011d53cd45d req-8236b539-f4e8-4a53-b489-a35999dad47c service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8f229491-5586-4f0c-ba68-3011d53cd45d req-8236b539-f4e8-4a53-b489-a35999dad47c service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-8f229491-5586-4f0c-ba68-3011d53cd45d req-8236b539-f4e8-4a53-b489-a35999dad47c service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-unplugged-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-8f229491-5586-4f0c-ba68-3011d53cd45d req-8236b539-f4e8-4a53-b489-a35999dad47c service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-ac119717-e6be-424f-9bc2-7961779c0b8a for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-3c253a42-82eb-4a89-9668-7a5b7cff5f11 req-5ca2dc82-40a5-4364-99cc-5afd9b0b76b8 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3c253a42-82eb-4a89-9668-7a5b7cff5f11 req-5ca2dc82-40a5-4364-99cc-5afd9b0b76b8 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3c253a42-82eb-4a89-9668-7a5b7cff5f11 req-5ca2dc82-40a5-4364-99cc-5afd9b0b76b8 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3c253a42-82eb-4a89-9668-7a5b7cff5f11 req-5ca2dc82-40a5-4364-99cc-5afd9b0b76b8 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-3c253a42-82eb-4a89-9668-7a5b7cff5f11 req-5ca2dc82-40a5-4364-99cc-5afd9b0b76b8 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-unplugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-3c253a42-82eb-4a89-9668-7a5b7cff5f11 req-5ca2dc82-40a5-4364-99cc-5afd9b0b76b8 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4229645-d842-40db-bfb6-1c03555461b8 req-5a6c90b2-0660-4d73-946b-2dc4c1b88a44 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4229645-d842-40db-bfb6-1c03555461b8 req-5a6c90b2-0660-4d73-946b-2dc4c1b88a44 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4229645-d842-40db-bfb6-1c03555461b8 req-5a6c90b2-0660-4d73-946b-2dc4c1b88a44 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4229645-d842-40db-bfb6-1c03555461b8 req-5a6c90b2-0660-4d73-946b-2dc4c1b88a44 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4229645-d842-40db-bfb6-1c03555461b8 req-5a6c90b2-0660-4d73-946b-2dc4c1b88a44 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-unplugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4229645-d842-40db-bfb6-1c03555461b8 req-5a6c90b2-0660-4d73-946b-2dc4c1b88a44 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] swap_volume: Updating volume 6547714e-25e5-438e-a03d-db6554617b40 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "lcZPvpgi", "auth_password": "VHOUBvAmch2z9N", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "a4bc8d2e-d623-4cd6-9ec2-0036933414dd"}, "status": "reserved", "instance": "64c90716-f424-4909-92ad-958a04f5b5a1", "attached_at": "", "detached_at": "", "volume_id": "a4bc8d2e-d623-4cd6-9ec2-0036933414dd", "serial": "a4bc8d2e-d623-4cd6-9ec2-0036933414dd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'no_device': None, 'attachment_id': '2c358425-00fb-4b0a-a03a-6d83ab37b857'} {{(pid=70914) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 27 13:35:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-297b5798-da2b-44b8-a444-9fac94298a60 tempest-TestVolumeSwap-60345443 tempest-TestVolumeSwap-60345443-project-admin] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.656s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Instance destroyed successfully.
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lazy-loading 'resources' on Instance uuid 3be64a2f-e1e6-4a27-9360-11ca508386b8 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "ac119717-e6be-424f-9bc2-7961779c0b8a", "address": "fa:16:3e:32:98:82", "network": {"id": "e3a24c64-3a40-403a-b01e-3701bd72a372", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-832728779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac119717-e6", "ovs_interfaceid": "ac119717-e6be-424f-9bc2-7961779c0b8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:98:82,bridge_name='br-int',has_traffic_filtering=True,id=ac119717-e6be-424f-9bc2-7961779c0b8a,network=Network(e3a24c64-3a40-403a-b01e-3701bd72a372),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac119717-e6') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:98:82,bridge_name='br-int',has_traffic_filtering=True,id=ac119717-e6be-424f-9bc2-7961779c0b8a,network=Network(e3a24c64-3a40-403a-b01e-3701bd72a372),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac119717-e6') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac119717-e6, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: INFO os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:98:82,bridge_name='br-int',has_traffic_filtering=True,id=ac119717-e6be-424f-9bc2-7961779c0b8a,network=Network(e3a24c64-3a40-403a-b01e-3701bd72a372),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac119717-e6')
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:d7:fc,bridge_name='br-int',has_traffic_filtering=True,id=8df8e238-9f60-4f78-aca5-6ff9661859f8,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8df8e238-9f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:d7:fc,bridge_name='br-int',has_traffic_filtering=True,id=8df8e238-9f60-4f78-aca5-6ff9661859f8,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8df8e238-9f') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8df8e238-9f, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: INFO os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:d7:fc,bridge_name='br-int',has_traffic_filtering=True,id=8df8e238-9f60-4f78-aca5-6ff9661859f8,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8df8e238-9f')
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:ac:5f,bridge_name='br-int',has_traffic_filtering=True,id=6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6cc23f26-86') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:ac:5f,bridge_name='br-int',has_traffic_filtering=True,id=6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6cc23f26-86') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cc23f26-86, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:36 user nova-compute[70914]: INFO os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:ac:5f,bridge_name='br-int',has_traffic_filtering=True,id=6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6cc23f26-86')
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:87,bridge_name='br-int',has_traffic_filtering=True,id=e67dafb4-ab9a-447c-9085-cb2f0aefd649,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67dafb4-ab') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:87,bridge_name='br-int',has_traffic_filtering=True,id=e67dafb4-ab9a-447c-9085-cb2f0aefd649,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67dafb4-ab') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:35:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape67dafb4-ab, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:37 user nova-compute[70914]: INFO os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:87,bridge_name='br-int',has_traffic_filtering=True,id=e67dafb4-ab9a-447c-9085-cb2f0aefd649,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67dafb4-ab')
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:95:46,bridge_name='br-int',has_traffic_filtering=True,id=b3edd8d1-9395-4ae3-ae2b-74b998fc365b,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3edd8d1-93') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:95:46,bridge_name='br-int',has_traffic_filtering=True,id=b3edd8d1-9395-4ae3-ae2b-74b998fc365b,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3edd8d1-93') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3edd8d1-93, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:35:37 user nova-compute[70914]: INFO os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:95:46,bridge_name='br-int',has_traffic_filtering=True,id=b3edd8d1-9395-4ae3-ae2b-74b998fc365b,network=Network(903ebf93-f9ed-4fe1-a92b-af349827b389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3edd8d1-93')
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:2b,bridge_name='br-int',has_traffic_filtering=True,id=7c5dd309-e38f-40fb-84cb-0df58ac3f4e8,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5dd309-e3') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:2b,bridge_name='br-int',has_traffic_filtering=True,id=7c5dd309-e38f-40fb-84cb-0df58ac3f4e8,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5dd309-e3') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c5dd309-e3, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:37 user nova-compute[70914]: INFO os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:2b,bridge_name='br-int',has_traffic_filtering=True,id=7c5dd309-e38f-40fb-84cb-0df58ac3f4e8,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5dd309-e3')
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118158250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118158250',id=11,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwAiNdnO4sCzsiZyYQejJ6azH0bSRmegjoIU5ht0Mx7hSYDyVNWmndNSYXr9w8X44ZQz0NJEuA/ShaPQU7N+8kB4DlY1A3QAje0CNUVj5cMP0fYmwzUWfob01ZZqGpVJA==',key_name='tempest-keypair-1143554508',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356427cedead46c4888b388a48a4f091',ramdisk_id='',reservation_id='r-yqc9s4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-55959234',owner_user_name='tempest-TaggedBootDevicesTest_v242-55959234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa2b954d0fa4f1aa64145dda9b31076',uuid=3be64a2f-e1e6-4a27-9360-11ca508386b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converting VIF {"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:69:4f,bridge_name='br-int',has_traffic_filtering=True,id=dd97a90d-8b37-4f9d-b880-6c5b83595442,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd97a90d-8b') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:69:4f,bridge_name='br-int',has_traffic_filtering=True,id=dd97a90d-8b37-4f9d-b880-6c5b83595442,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd97a90d-8b') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd97a90d-8b, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:37 user nova-compute[70914]: INFO os_vif [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:69:4f,bridge_name='br-int',has_traffic_filtering=True,id=dd97a90d-8b37-4f9d-b880-6c5b83595442,network=Network(5f68eaee-7c8f-48f1-b4cc-8cad556cb323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd97a90d-8b')
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKbtyVlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:37 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:37 user nova-compute[70914]: WARNING nova.compute.manager [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-ac119717-e6be-424f-9bc2-7961779c0b8a for instance with vm_state active and task_state deleting.
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-unplugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:37 user nova-compute[70914]: WARNING nova.compute.manager [req-ed45051b-aaec-410b-a7e6-16bf4ef46045 req-ebc046ef-ad61-4049-b69c-7d2cca4e84b1 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-b3edd8d1-9395-4ae3-ae2b-74b998fc365b for instance with vm_state active and task_state deleting.
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf4a1f-7acb-488d-8db4-210756afcd68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:35:37 user nova-compute[70914]: No targets found.
Jul 27 13:35:37 user nova-compute[70914]: iSNS:
Jul 27 13:35:37 user nova-compute[70914]: No targets found.
Jul 27 13:35:37 user nova-compute[70914]: STATIC:
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: FIRMWARE:
Jul 27 13:35:37 user nova-compute[70914]: No targets found.
Jul 27 13:35:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:35:37 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:35:37 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b2ec1-8118-4b6c-a2c8-8b6b6dd24ea4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:37 user nova-compute[70914]: WARNING nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-8df8e238-9f60-4f78-aca5-6ff9661859f8 for instance with vm_state active and task_state deleting.
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-unplugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:37 user nova-compute[70914]: WARNING nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf for instance with vm_state active and task_state deleting.
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-unplugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-976d4353-7755-4517-b01a-38f9573ab95c req-1a8cad97-0e1e-4593-bf48-7a472f2795cf service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e52aba6-96e7-415c-a4f3-433210c768ad]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18602440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4287516-cb98-4ebf-884f-3cb7e7bd8778]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: INFO nova.compute.manager [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Detaching volume a4bc8d2e-d623-4cd6-9ec2-0036933414dd
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[435af90e-f0ae-4ca8-b723-193b27d43a69]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1424a3bc-08ee-42f7-9a89-385d25d12707]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: INFO nova.virt.block_device [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Attempting to driver detach volume a4bc8d2e-d623-4cd6-9ec2-0036933414dd from mountpoint /dev/vdb
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7eb1a1-2eb3-47e6-8f58-d99bb77d731a]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Attempting to detach device vdb from instance 64c90716-f424-4909-92ad-958a04f5b5a1 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:35:37 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:35:37 user nova-compute[70914]:   <source dev="/dev/sdg"/>
Jul 27 13:35:37 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:35:37 user nova-compute[70914]:   <serial>a4bc8d2e-d623-4cd6-9ec2-0036933414dd</serial>
Jul 27 13:35:37 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:35:37 user nova-compute[70914]: </disk>
Jul 27 13:35:37 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Successfully detached device vdb from instance 64c90716-f424-4909-92ad-958a04f5b5a1 from the persistent domain config.
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64c90716-f424-4909-92ad-958a04f5b5a1 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:35:37 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:35:37 user nova-compute[70914]:   <source dev="/dev/sdg"/>
Jul 27 13:35:37 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:35:37 user nova-compute[70914]:   <serial>a4bc8d2e-d623-4cd6-9ec2-0036933414dd</serial>
Jul 27 13:35:37 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:35:37 user nova-compute[70914]: </disk>
Jul 27 13:35:37 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9be238-52df-498c-aae5-a2e6cf05606a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4558bb84-35ff-425d-b48c-482620ee3000]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e, portal: 172.16.0.220,3260]
Jul 27 13:35:37 user nova-compute[70914]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:675346a7-06c2-4b12-8cbf-c4d06766e30e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc234818-b81e-4a85-b436-e9e2f70f3eef]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.529s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] <== disconnect_volume: return (531ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:37 user nova-compute[70914]: WARNING nova.compute.manager [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 for instance with vm_state active and task_state deleting.
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-unplugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-unplugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.compute.manager [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:37 user nova-compute[70914]: WARNING nova.compute.manager [req-d5c7348f-a662-414d-b5b7-1973a819cfce req-558c1650-a558-4d6b-860e-b357635f0e08 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-dd97a90d-8b37-4f9d-b880-6c5b83595442 for instance with vm_state active and task_state deleting.
Jul 27 13:35:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGnTKiHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:37 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d302fa-b232-4cd9-ae39-e0468918af17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:35:37 user nova-compute[70914]: No targets found.
Jul 27 13:35:37 user nova-compute[70914]: iSNS:
Jul 27 13:35:37 user nova-compute[70914]: No targets found.
Jul 27 13:35:37 user nova-compute[70914]: STATIC:
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:35:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:37 user nova-compute[70914]: FIRMWARE:
Jul 27 13:35:37 user nova-compute[70914]: No targets found.
Jul 27 13:35:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:35:37 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:35:37 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd9258d-e3db-4fd4-aa5b-7314657a34d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e658d193-fe22-4001-acef-c35070660ad3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c3c0bbe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2'): ({'sdc'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Removing single pathed devices sdc {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba69a6e8-059f-412f-a8cf-61d05a25fbba]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3472f3-c972-4a53-a29e-041799d070a2]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Flushing IO for device /dev/sdc {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:35:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[150eab50-628f-497d-8a7b-b6e0b1e36cac]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d0d68a-9b4c-4104-9a8b-80dab8c32114]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae3aa99-8881-4b1f-9377-5a4750587670]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bea306-269b-4319-b15b-cf56b44e9567]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2, portal: 172.16.0.220,3260]
Jul 27 13:35:38 user nova-compute[70914]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690464938.1826732, 64c90716-f424-4909-92ad-958a04f5b5a1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64c90716-f424-4909-92ad-958a04f5b5a1 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Successfully detached device vdb from instance 64c90716-f424-4909-92ad-958a04f5b5a1 from the live domain config.
Jul 27 13:35:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZPvpgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'a4bc8d2e-d623-4cd6-9ec2-0036933414dd'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:38 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b90224b-16eb-4f52-b05e-673ae82d59e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc1e1c6-cd7a-4bd4-a0f0-b551ba915770]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] <== disconnect_volume: return (397ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.025s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a16dfae-b375-4528-aef1-1c38b71d3107]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:35:38 user nova-compute[70914]: No targets found.
Jul 27 13:35:38 user nova-compute[70914]: iSNS:
Jul 27 13:35:38 user nova-compute[70914]: No targets found.
Jul 27 13:35:38 user nova-compute[70914]: STATIC:
Jul 27 13:35:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:35:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd
Jul 27 13:35:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d
Jul 27 13:35:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:35:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:38 user nova-compute[70914]: FIRMWARE:
Jul 27 13:35:38 user nova-compute[70914]: No targets found.
Jul 27 13:35:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:35:38 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:35:38 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmAQWoEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:35:38 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2444a6-045c-4f07-93e9-b12c27a7719f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e49969f-570a-470a-963c-4f6adad6d3be]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:38 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:38 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:38 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd (non-flash)
Jul 27 13:35:38 user nova-compute[70914]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:38 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:38 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c3c0bbe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd'): ({'sdg'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Removing single pathed devices sdg {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f85606e-6a51-4aee-8375-22d48e2d5f13]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4564624a-fb91-4dd1-a0a9-73cadec1a929]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Flushing IO for device /dev/sdg {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24a15d5-2ee6-4114-aa40-9369cf4e56df]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d3df30-7cda-439c-877c-2bbc600fe517]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] SCSI volumes sdg have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[76903c3a-38a0-4916-af9b-faff3526f867]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[123b4544-2e8b-432d-965a-56b62771b814]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260]
Jul 27 13:35:38 user nova-compute[70914]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bc8d2e-d623-4cd6-9ec2-0036933414dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71fef2f-6c6e-41f3-ad25-d607fbfe5efc]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] <== disconnect_volume: return (408ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.345s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[39670c53-9392-4fd8-95e5-fdd008e71432]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:35:38 user nova-compute[70914]: No targets found.
Jul 27 13:35:38 user nova-compute[70914]: iSNS:
Jul 27 13:35:38 user nova-compute[70914]: No targets found.
Jul 27 13:35:38 user nova-compute[70914]: STATIC:
Jul 27 13:35:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:35:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d
Jul 27 13:35:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:35:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:35:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:35:38 user nova-compute[70914]: FIRMWARE:
Jul 27 13:35:38 user nova-compute[70914]: No targets found.
Jul 27 13:35:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:35:38 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:35:38 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4042617b-3002-4f67-8550-1ba57d8af1d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa0d648-9a25-4de1-a927-8dd07cfcb411]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:38 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:38 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d (non-flash)
Jul 27 13:35:38 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:35:38 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:35:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c186024d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d'): ({'sdd'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Removing single pathed devices sdd {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[35705146-4c3e-43ff-bd88-6ed39086e1cf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4b7a4b-44ee-4dcc-ac52-a652dc812e5e]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Flushing IO for device /dev/sdd {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fa76a9-990f-4111-8c7a-8de9c577390b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddc9389-4400-40e3-bede-0e89aeb1face]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ab3280-f759-43e7-addd-1da827c14085]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cd3af2-27c6-4c89-9603-0aae7b3e329b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d, portal: 172.16.0.220,3260]
Jul 27 13:35:38 user nova-compute[70914]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d, portal: 172.16.0.220,3260] successful.
Jul 27 13:35:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8116e64-e6a7-4f84-95e1-573e7b92f19d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[de36937b-6e6f-4f48-b860-e74abdc2a944]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:35:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] <== disconnect_volume: return (725ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:35:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Deleting instance files /opt/stack/data/nova/instances/3be64a2f-e1e6-4a27-9360-11ca508386b8_del
Jul 27 13:35:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Deletion of /opt/stack/data/nova/instances/3be64a2f-e1e6-4a27-9360-11ca508386b8_del complete
Jul 27 13:35:39 user nova-compute[70914]: INFO nova.compute.manager [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Took 4.57 seconds to destroy the instance on the hypervisor.
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-faedc3c9-cb89-4a59-b64d-dca8648c70cd req-05cfe679-cf9a-4765-9fe4-ec1bead07a36 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-plugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-faedc3c9-cb89-4a59-b64d-dca8648c70cd req-05cfe679-cf9a-4765-9fe4-ec1bead07a36 service nova] Acquiring lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-faedc3c9-cb89-4a59-b64d-dca8648c70cd req-05cfe679-cf9a-4765-9fe4-ec1bead07a36 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-faedc3c9-cb89-4a59-b64d-dca8648c70cd req-05cfe679-cf9a-4765-9fe4-ec1bead07a36 service nova] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-faedc3c9-cb89-4a59-b64d-dca8648c70cd req-05cfe679-cf9a-4765-9fe4-ec1bead07a36 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] No waiting events found dispatching network-vif-plugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:35:39 user nova-compute[70914]: WARNING nova.compute.manager [req-faedc3c9-cb89-4a59-b64d-dca8648c70cd req-05cfe679-cf9a-4765-9fe4-ec1bead07a36 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received unexpected event network-vif-plugged-e67dafb4-ab9a-447c-9085-cb2f0aefd649 for instance with vm_state active and task_state deleting.
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG nova.objects.instance [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lazy-loading 'flavor' on Instance uuid 64c90716-f424-4909-92ad-958a04f5b5a1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:35:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9c18718f-3d52-4038-8555-9046a945aafa tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.662s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:35:41 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:35:41 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=6963MB free_disk=25.642074584960938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 38108984-8bd8-49b6-9111-33c084a5a16a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance d54b6163-cc14-44d4-91c6-d306168bb875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 74b5062f-99eb-44aa-911a-f5dd360923cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 64c90716-f424-4909-92ad-958a04f5b5a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3be64a2f-e1e6-4a27-9360-11ca508386b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance f50d948b-6955-4c9e-afa8-1a513ba1e715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 2f25226c-952e-482b-b2c1-77384b67bbed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 5a33a308-264e-445b-a47e-1b62773b4d6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:35:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:35:42 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:35:42 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:35:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:35:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:42 user nova-compute[70914]: DEBUG nova.compute.manager [req-b885e6a1-bc53-4822-8930-b9ce18997333 req-eea8cd7b-93a1-4c29-bb70-3316a81e7548 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-deleted-ac119717-e6be-424f-9bc2-7961779c0b8a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:42 user nova-compute[70914]: INFO nova.compute.manager [req-b885e6a1-bc53-4822-8930-b9ce18997333 req-eea8cd7b-93a1-4c29-bb70-3316a81e7548 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Neutron deleted interface ac119717-e6be-424f-9bc2-7961779c0b8a; detaching it from the instance and deleting it from the info cache
Jul 27 13:35:42 user nova-compute[70914]: DEBUG nova.network.neutron [req-b885e6a1-bc53-4822-8930-b9ce18997333 req-eea8cd7b-93a1-4c29-bb70-3316a81e7548 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [{"id": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "address": "fa:16:3e:60:d7:fc", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df8e238-9f", "ovs_interfaceid": "8df8e238-9f60-4f78-aca5-6ff9661859f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "address": "fa:16:3e:32:ac:5f", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc23f26-86", "ovs_interfaceid": "6cc23f26-86e4-4b1a-b3aa-dcaa2f53dcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "address": "fa:16:3e:18:69:87", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67dafb4-ab", "ovs_interfaceid": "e67dafb4-ab9a-447c-9085-cb2f0aefd649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "address": "fa:16:3e:9a:95:46", "network": {"id": "903ebf93-f9ed-4fe1-a92b-af349827b389", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036836921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3edd8d1-93", "ovs_interfaceid": "b3edd8d1-9395-4ae3-ae2b-74b998fc365b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "address": "fa:16:3e:8d:c7:2b", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5dd309-e3", "ovs_interfaceid": "7c5dd309-e38f-40fb-84cb-0df58ac3f4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "address": "fa:16:3e:0c:69:4f", "network": {"id": "5f68eaee-7c8f-48f1-b4cc-8cad556cb323", "bridge": "br-int", "label": "tempest-device-tagging-net2-2022904180", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "356427cedead46c4888b388a48a4f091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd97a90d-8b", "ovs_interfaceid": "dd97a90d-8b37-4f9d-b880-6c5b83595442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:35:42 user nova-compute[70914]: DEBUG nova.compute.manager [req-b885e6a1-bc53-4822-8930-b9ce18997333 req-eea8cd7b-93a1-4c29-bb70-3316a81e7548 service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Detach interface failed, port_id=ac119717-e6be-424f-9bc2-7961779c0b8a, reason: Instance 3be64a2f-e1e6-4a27-9360-11ca508386b8 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:35:43 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:35:43 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Took 4.60 seconds to deallocate network for instance.
Jul 27 13:35:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a2d341d-e2e6-43ff-bac4-720db0cebf42 req-971687c0-c53f-4abe-beee-d0e3af6ca09d service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-deleted-b3edd8d1-9395-4ae3-ae2b-74b998fc365b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a2d341d-e2e6-43ff-bac4-720db0cebf42 req-971687c0-c53f-4abe-beee-d0e3af6ca09d service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-deleted-7c5dd309-e38f-40fb-84cb-0df58ac3f4e8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a2d341d-e2e6-43ff-bac4-720db0cebf42 req-971687c0-c53f-4abe-beee-d0e3af6ca09d service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-deleted-dd97a90d-8b37-4f9d-b880-6c5b83595442 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a2d341d-e2e6-43ff-bac4-720db0cebf42 req-971687c0-c53f-4abe-beee-d0e3af6ca09d service nova] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Received event network-vif-deleted-e67dafb4-ab9a-447c-9085-cb2f0aefd649 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating instance_info_cache with network_info: [{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:35:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:35:45 user nova-compute[70914]: INFO nova.compute.manager [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Took 2.15 seconds to detach 3 volumes for instance.
Jul 27 13:35:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:35:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:35:46 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:35:46 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:35:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:46 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Deleted allocations for instance 3be64a2f-e1e6-4a27-9360-11ca508386b8
Jul 27 13:35:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d9193200-89f3-46c5-831e-914eaf468762 tempest-TaggedBootDevicesTest_v242-55959234 tempest-TaggedBootDevicesTest_v242-55959234-project-member] Lock "3be64a2f-e1e6-4a27-9360-11ca508386b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.006s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:35:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:35:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:51 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690464936.4045763, 3be64a2f-e1e6-4a27-9360-11ca508386b8 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:35:51 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] VM Stopped (Lifecycle Event)
Jul 27 13:35:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-267ac5f1-2fae-41bc-ae72-f1b126c72b72 None None] [instance: 3be64a2f-e1e6-4a27-9360-11ca508386b8] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:35:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:35:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:01 user nova-compute[70914]: INFO nova.compute.manager [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Terminating instance
Jul 27 13:36:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:36:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-1f165723-b5bb-40d7-af2b-0554b4c0206a req-77fdb23c-027d-49ee-96fb-5240c77a492f service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-unplugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f165723-b5bb-40d7-af2b-0554b4c0206a req-77fdb23c-027d-49ee-96fb-5240c77a492f service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f165723-b5bb-40d7-af2b-0554b4c0206a req-77fdb23c-027d-49ee-96fb-5240c77a492f service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f165723-b5bb-40d7-af2b-0554b4c0206a req-77fdb23c-027d-49ee-96fb-5240c77a492f service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-1f165723-b5bb-40d7-af2b-0554b4c0206a req-77fdb23c-027d-49ee-96fb-5240c77a492f service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-unplugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-1f165723-b5bb-40d7-af2b-0554b4c0206a req-77fdb23c-027d-49ee-96fb-5240c77a492f service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-unplugged-9e24abbc-7b7d-4353-be75-303948818880 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Instance destroyed successfully.
Jul 27 13:36:02 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lazy-loading 'resources' on Instance uuid 74b5062f-99eb-44aa-911a-f5dd360923cb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686130538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686130538',id=9,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEPkG6YoBHNN1m07ICeDwsyBe3EyiCC5ZWV6mXw/+7QEA9m0AfwawXSd08u+IL5UEExXheTC9Q9XOElwPRpKRh7aBnH+il5ROUwwz9yELcy4nnvhviPGllDQupgOGxxtw==',key_name='tempest-keypair-1523997644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076bc6cb188749f29bd33e8d72fd5d27',ramdisk_id='',reservation_id='r-4xtevblr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1370278240',owner_user_name='tempest-TaggedAttachmentsTest-1370278240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7831e5cefa7142c0a1ff99f0fcba6d12',uuid=74b5062f-99eb-44aa-911a-f5dd360923cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converting VIF {"id": "9e24abbc-7b7d-4353-be75-303948818880", "address": "fa:16:3e:27:0c:51", "network": {"id": "d69b8cde-d4ad-4974-8435-d5add4c76553", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1392289091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076bc6cb188749f29bd33e8d72fd5d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e24abbc-7b", "ovs_interfaceid": "9e24abbc-7b7d-4353-be75-303948818880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:0c:51,bridge_name='br-int',has_traffic_filtering=True,id=9e24abbc-7b7d-4353-be75-303948818880,network=Network(d69b8cde-d4ad-4974-8435-d5add4c76553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e24abbc-7b') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG os_vif [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:0c:51,bridge_name='br-int',has_traffic_filtering=True,id=9e24abbc-7b7d-4353-be75-303948818880,network=Network(d69b8cde-d4ad-4974-8435-d5add4c76553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e24abbc-7b') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e24abbc-7b, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:02 user nova-compute[70914]: INFO os_vif [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:0c:51,bridge_name='br-int',has_traffic_filtering=True,id=9e24abbc-7b7d-4353-be75-303948818880,network=Network(d69b8cde-d4ad-4974-8435-d5add4c76553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e24abbc-7b')
Jul 27 13:36:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Deleting instance files /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb_del
Jul 27 13:36:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Deletion of /opt/stack/data/nova/instances/74b5062f-99eb-44aa-911a-f5dd360923cb_del complete
Jul 27 13:36:02 user nova-compute[70914]: INFO nova.compute.manager [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 27 13:36:02 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:36:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:03 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:03 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Took 1.09 seconds to deallocate network for instance.
Jul 27 13:36:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-a64402ce-800c-4916-baa9-afaa5ae7f189 req-609b2486-7a3e-4939-ae76-6ffdb1ec56ed service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-deleted-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:03 user nova-compute[70914]: INFO nova.compute.manager [req-a64402ce-800c-4916-baa9-afaa5ae7f189 req-609b2486-7a3e-4939-ae76-6ffdb1ec56ed service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Neutron deleted interface 9e24abbc-7b7d-4353-be75-303948818880; detaching it from the instance and deleting it from the info cache
Jul 27 13:36:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-a64402ce-800c-4916-baa9-afaa5ae7f189 req-609b2486-7a3e-4939-ae76-6ffdb1ec56ed service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a64402ce-800c-4916-baa9-afaa5ae7f189 req-609b2486-7a3e-4939-ae76-6ffdb1ec56ed service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Detach interface failed, port_id=9e24abbc-7b7d-4353-be75-303948818880, reason: Instance 74b5062f-99eb-44aa-911a-f5dd360923cb could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:04 user nova-compute[70914]: WARNING nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 for instance with vm_state deleted and task_state None.
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:04 user nova-compute[70914]: WARNING nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 for instance with vm_state deleted and task_state None.
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:04 user nova-compute[70914]: WARNING nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 for instance with vm_state deleted and task_state None.
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-unplugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-unplugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:04 user nova-compute[70914]: WARNING nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-unplugged-9e24abbc-7b7d-4353-be75-303948818880 for instance with vm_state deleted and task_state None.
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Acquiring lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] No waiting events found dispatching network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:04 user nova-compute[70914]: WARNING nova.compute.manager [req-a4f2cc52-2aa7-4b43-a9a4-c88b1f1a083b req-e8e3eead-7d09-4ffe-aa4e-4dfabac3b100 service nova] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Received unexpected event network-vif-plugged-9e24abbc-7b7d-4353-be75-303948818880 for instance with vm_state deleted and task_state None.
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:04 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Deleted allocations for instance 74b5062f-99eb-44aa-911a-f5dd360923cb
Jul 27 13:36:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d4b3155-b3c9-4b91-beff-ab1cc5ceba59 tempest-TaggedAttachmentsTest-1370278240 tempest-TaggedAttachmentsTest-1370278240-project-member] Lock "74b5062f-99eb-44aa-911a-f5dd360923cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.672s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "f50d948b-6955-4c9e-afa8-1a513ba1e715" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:05 user nova-compute[70914]: INFO nova.compute.manager [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Terminating instance
Jul 27 13:36:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-a71df44c-2d50-4d33-9c05-f98fe360e18c req-c944f33b-f512-49de-add0-b87031e78bdb service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Received event network-vif-unplugged-fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a71df44c-2d50-4d33-9c05-f98fe360e18c req-c944f33b-f512-49de-add0-b87031e78bdb service nova] Acquiring lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a71df44c-2d50-4d33-9c05-f98fe360e18c req-c944f33b-f512-49de-add0-b87031e78bdb service nova] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a71df44c-2d50-4d33-9c05-f98fe360e18c req-c944f33b-f512-49de-add0-b87031e78bdb service nova] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-a71df44c-2d50-4d33-9c05-f98fe360e18c req-c944f33b-f512-49de-add0-b87031e78bdb service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] No waiting events found dispatching network-vif-unplugged-fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-a71df44c-2d50-4d33-9c05-f98fe360e18c req-c944f33b-f512-49de-add0-b87031e78bdb service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Received event network-vif-unplugged-fee95532-9ed0-41e0-8bad-6b789543939a for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Instance destroyed successfully.
Jul 27 13:36:06 user nova-compute[70914]: DEBUG nova.objects.instance [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lazy-loading 'resources' on Instance uuid f50d948b-6955-4c9e-afa8-1a513ba1e715 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2026646985',display_name='tempest-ServersNegativeTestJSON-server-2026646985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2026646985',id=12,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e59369b8cbb148fc9d60ef1513579205',ramdisk_id='',reservation_id='r-hc03isiv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1243391903',owner_user_name='tempest-ServersNegativeTestJSON-1243391903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:24Z,user_data=None,user_id='84825f59c7be48698b64b0f24ab85b1e',uuid=f50d948b-6955-4c9e-afa8-1a513ba1e715,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fee95532-9ed0-41e0-8bad-6b789543939a", "address": "fa:16:3e:38:ac:f3", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95532-9e", "ovs_interfaceid": "fee95532-9ed0-41e0-8bad-6b789543939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converting VIF {"id": "fee95532-9ed0-41e0-8bad-6b789543939a", "address": "fa:16:3e:38:ac:f3", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95532-9e", "ovs_interfaceid": "fee95532-9ed0-41e0-8bad-6b789543939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=fee95532-9ed0-41e0-8bad-6b789543939a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95532-9e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG os_vif [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=fee95532-9ed0-41e0-8bad-6b789543939a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95532-9e') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfee95532-9e, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:06 user nova-compute[70914]: INFO os_vif [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=fee95532-9ed0-41e0-8bad-6b789543939a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95532-9e')
Jul 27 13:36:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Deleting instance files /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715_del
Jul 27 13:36:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Deletion of /opt/stack/data/nova/instances/f50d948b-6955-4c9e-afa8-1a513ba1e715_del complete
Jul 27 13:36:06 user nova-compute[70914]: INFO nova.compute.manager [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Took 0.76 seconds to destroy the instance on the hypervisor.
Jul 27 13:36:06 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:06 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Took 0.48 seconds to deallocate network for instance.
Jul 27 13:36:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-eb4dfd06-bcf4-43e6-b5d5-7141559e10c4 req-b9869fa4-34c8-488d-9cb2-3d999f7bc928 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Received event network-vif-deleted-fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:06 user nova-compute[70914]: INFO nova.compute.manager [req-eb4dfd06-bcf4-43e6-b5d5-7141559e10c4 req-b9869fa4-34c8-488d-9cb2-3d999f7bc928 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Neutron deleted interface fee95532-9ed0-41e0-8bad-6b789543939a; detaching it from the instance and deleting it from the info cache
Jul 27 13:36:06 user nova-compute[70914]: DEBUG nova.network.neutron [req-eb4dfd06-bcf4-43e6-b5d5-7141559e10c4 req-b9869fa4-34c8-488d-9cb2-3d999f7bc928 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-eb4dfd06-bcf4-43e6-b5d5-7141559e10c4 req-b9869fa4-34c8-488d-9cb2-3d999f7bc928 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Detach interface failed, port_id=fee95532-9ed0-41e0-8bad-6b789543939a, reason: Instance f50d948b-6955-4c9e-afa8-1a513ba1e715 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:07 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:36:07 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:36:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:07 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Deleted allocations for instance f50d948b-6955-4c9e-afa8-1a513ba1e715
Jul 27 13:36:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6239b0cf-3f85-41e3-ab7a-bd9b7352b2a4 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.828s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-73ce9077-d258-4ef3-9230-20c9ee8fe65b req-4bc563c1-4572-428d-ab5a-4df7ab96ace9 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Received event network-vif-plugged-fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-73ce9077-d258-4ef3-9230-20c9ee8fe65b req-4bc563c1-4572-428d-ab5a-4df7ab96ace9 service nova] Acquiring lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-73ce9077-d258-4ef3-9230-20c9ee8fe65b req-4bc563c1-4572-428d-ab5a-4df7ab96ace9 service nova] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-73ce9077-d258-4ef3-9230-20c9ee8fe65b req-4bc563c1-4572-428d-ab5a-4df7ab96ace9 service nova] Lock "f50d948b-6955-4c9e-afa8-1a513ba1e715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-73ce9077-d258-4ef3-9230-20c9ee8fe65b req-4bc563c1-4572-428d-ab5a-4df7ab96ace9 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] No waiting events found dispatching network-vif-plugged-fee95532-9ed0-41e0-8bad-6b789543939a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:07 user nova-compute[70914]: WARNING nova.compute.manager [req-73ce9077-d258-4ef3-9230-20c9ee8fe65b req-4bc563c1-4572-428d-ab5a-4df7ab96ace9 service nova] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Received unexpected event network-vif-plugged-fee95532-9ed0-41e0-8bad-6b789543939a for instance with vm_state deleted and task_state None.
Jul 27 13:36:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:13 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'flavor' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:14 user nova-compute[70914]: INFO nova.compute.manager [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Attaching volume 0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 to /dev/vdb
Jul 27 13:36:14 user nova-compute[70914]: DEBUG os_brick.utils [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7952a-b8eb-4c2a-898e-3d9db9398c41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2b45a7-cd54-4f59-80d0-cc57d3d00c9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[321487c4-6d45-414e-9373-84b0caa2420c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69452c6-2753-4881-bf4b-74cceeb1cfb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:36:14 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:36:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3208eee-9c64-4245-8ef7-95a923fc8f61]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG os_brick.utils [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:14 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating existing volume attachment record: ad2a6052-5986-4b24-bcaa-ab7159e7fa12 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:36:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:17 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690464962.6943448, 74b5062f-99eb-44aa-911a-f5dd360923cb => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:17 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] VM Stopped (Lifecycle Event)
Jul 27 13:36:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a80d45e0-411f-4f9a-a9b4-85596159a509 None None] [instance: 74b5062f-99eb-44aa-911a-f5dd360923cb] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690464966.2295756, f50d948b-6955-4c9e-afa8-1a513ba1e715 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:21 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] VM Stopped (Lifecycle Event)
Jul 27 13:36:21 user nova-compute[70914]: DEBUG nova.compute.manager [None req-842cb0fd-228b-4cdd-a91d-1aaa0dca2d69 None None] [instance: f50d948b-6955-4c9e-afa8-1a513ba1e715] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:21 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:21 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:21 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[768a5228-4257-4e02-aec7-093b8175ac83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:36:21 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9492bfa-f3e5-47ba-b59f-e4c9031035fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98] added
Jul 27 13:36:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da2c08d-a276-4072-b493-25c50011e323]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c239918-04db-45ac-b83e-9e288f8cbc03]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgeofZBA {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgeofZBA" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a974b3-6950-4cb8-940b-2f095da6025f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgeofZBA'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88c9b66-fec5-4793-80a3-467c14017eb3]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efa5074-9dd0-4b79-8820-7a256fa4c243]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:21 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:36:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:21 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:36:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf0c5b8-ca56-435c-9d09-f49098e91812]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]
Jul 27 13:36:21 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.
Jul 27 13:36:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[236c21ba-5c60-423a-984f-365f0d27fcb7]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf25559d-59e1-4853-bc4d-b97f0cead97b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:21 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:21 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:36:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:21 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:21 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:36:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4681fc-4a65-4825-a633-12e9f0faa76d]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:36:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:36:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-67f5873a-aba9-4488-a1a1-317aced80164 req-975bcd2d-7cb7-4f02-b75c-0dacc9542eda service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-changed-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-67f5873a-aba9-4488-a1a1-317aced80164 req-975bcd2d-7cb7-4f02-b75c-0dacc9542eda service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Refreshing instance network info cache due to event network-changed-ae2338c5-670a-42f8-999b-8e9fdbb83378. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:36:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-67f5873a-aba9-4488-a1a1-317aced80164 req-975bcd2d-7cb7-4f02-b75c-0dacc9542eda service nova] Acquiring lock "refresh_cache-2f25226c-952e-482b-b2c1-77384b67bbed" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:36:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-67f5873a-aba9-4488-a1a1-317aced80164 req-975bcd2d-7cb7-4f02-b75c-0dacc9542eda service nova] Acquired lock "refresh_cache-2f25226c-952e-482b-b2c1-77384b67bbed" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:36:22 user nova-compute[70914]: DEBUG nova.network.neutron [req-67f5873a-aba9-4488-a1a1-317aced80164 req-975bcd2d-7cb7-4f02-b75c-0dacc9542eda service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Refreshing network info cache for port ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:36:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23363353465353932', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363353465353932', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'flavor' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:36:23 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:36:23 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:36:23 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:36:23 user nova-compute[70914]:   <serial>0df6dc3b-018b-4dfb-afb9-6a2efcda4b98</serial>
Jul 27 13:36:23 user nova-compute[70914]: </disk>
Jul 27 13:36:23 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.network.neutron [req-67f5873a-aba9-4488-a1a1-317aced80164 req-975bcd2d-7cb7-4f02-b75c-0dacc9542eda service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Updated VIF entry in instance network info cache for port ae2338c5-670a-42f8-999b-8e9fdbb83378. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.network.neutron [req-67f5873a-aba9-4488-a1a1-317aced80164 req-975bcd2d-7cb7-4f02-b75c-0dacc9542eda service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Updating instance_info_cache with network_info: [{"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-67f5873a-aba9-4488-a1a1-317aced80164 req-975bcd2d-7cb7-4f02-b75c-0dacc9542eda service nova] Releasing lock "refresh_cache-2f25226c-952e-482b-b2c1-77384b67bbed" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] No VIF found with MAC fa:16:3e:5c:af:6f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:36:23 user nova-compute[70914]: INFO nova.compute.manager [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Rebuilding instance
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f25226c-952e-482b-b2c1-77384b67bbed {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8fe7baa1-0aa8-4fd4-a39f-68e1b2eed317 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.535s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'pci_requests' on Instance uuid 2f25226c-952e-482b-b2c1-77384b67bbed {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f25226c-952e-482b-b2c1-77384b67bbed {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'resources' on Instance uuid 2f25226c-952e-482b-b2c1-77384b67bbed {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'migration_context' on Instance uuid 2f25226c-952e-482b-b2c1-77384b67bbed {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70914) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-21977c0d-1a0a-46b6-86a8-8dbbbc969c55 req-798f764d-97d3-4643-9fb0-12ad45ac0586 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-vif-unplugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-21977c0d-1a0a-46b6-86a8-8dbbbc969c55 req-798f764d-97d3-4643-9fb0-12ad45ac0586 service nova] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-21977c0d-1a0a-46b6-86a8-8dbbbc969c55 req-798f764d-97d3-4643-9fb0-12ad45ac0586 service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-21977c0d-1a0a-46b6-86a8-8dbbbc969c55 req-798f764d-97d3-4643-9fb0-12ad45ac0586 service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-21977c0d-1a0a-46b6-86a8-8dbbbc969c55 req-798f764d-97d3-4643-9fb0-12ad45ac0586 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] No waiting events found dispatching network-vif-unplugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:24 user nova-compute[70914]: WARNING nova.compute.manager [req-21977c0d-1a0a-46b6-86a8-8dbbbc969c55 req-798f764d-97d3-4643-9fb0-12ad45ac0586 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received unexpected event network-vif-unplugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 for instance with vm_state active and task_state rebuilding.
Jul 27 13:36:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:24 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Instance destroyed successfully.
Jul 27 13:36:24 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Instance destroyed successfully.
Jul 27 13:36:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1222468261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2055353492',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OojAdixfznGFq1DFKNCIKxcrjX+E9vG3RnHr9K0gfako8L+aQbe5jQFEZ9xGSZx+L1z6hfai/IJzJVF4i0/HETmmSR8l0MTYoqWjUkVS3bqQMlxlDM9T3JIc6tBeVwg==',key_name='tempest-keypair-666687196',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4c94597dacc420abba408e3b60f4a40',ramdisk_id='',reservation_id='r-wlsu70h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1997290170',owner_user_name='tempest-ServerActionsV293TestJSON-1997290170-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:36:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9279e1abc6946bc970fa3b2b2119c67',uuid=2f25226c-952e-482b-b2c1-77384b67bbed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converting VIF {"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_vif [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae2338c5-67, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:24 user nova-compute[70914]: INFO os_vif [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67')
Jul 27 13:36:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIPfQUrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:24 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f29db34-f674-4b7a-a442-6d0d4049f765]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:36:24 user nova-compute[70914]: No targets found.
Jul 27 13:36:24 user nova-compute[70914]: iSNS:
Jul 27 13:36:24 user nova-compute[70914]: No targets found.
Jul 27 13:36:24 user nova-compute[70914]: STATIC:
Jul 27 13:36:24 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:36:24 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:36:24 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:36:24 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:36:24 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:36:24 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:36:24 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:36:24 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:36:24 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:36:24 user nova-compute[70914]: FIRMWARE:
Jul 27 13:36:24 user nova-compute[70914]: No targets found.
Jul 27 13:36:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:36:24 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:36:24 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56dec2e-9525-4bd1-84d6-537364144662]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81f9356-1ae8-4da3-806a-cb9e4e9b62ad]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:24 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:24 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:36:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:24 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:24 user nova-compute[70914]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:36:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c187b7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68'): ({'sdf'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Removing single pathed devices sdf {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[411e4af3-19f1-4a9b-8c9d-68eb5eb82d7f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5436ac-e18a-469a-b387-5049fea68b3f]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Flushing IO for device /dev/sdf {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a76daa4-0ac3-49b0-ab31-d4def423fc1a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abcf8d7-20f6-461b-9309-cc510152f2c2]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] SCSI volumes sdf have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4b8899bf-5057fb70173021da', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4b8899bf', '/dev/disk/by-id/scsi-23530353766623730') {{(pid=82182) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1361e2-d4f7-4d9b-861d-980c812bbafd]: (4, None) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118ad87-5dc6-4836-b68d-c09fa6c7f1e8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[259f810d-b985-48b5-89ed-e81491e21626]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260]
Jul 27 13:36:24 user nova-compute[70914]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260] successful.
Jul 27 13:36:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[84af5799-8dae-4e84-a81c-b116ed4120a2]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] <== disconnect_volume: return (334ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:36:24 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Deleting instance files /opt/stack/data/nova/instances/2f25226c-952e-482b-b2c1-77384b67bbed_del
Jul 27 13:36:24 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Deletion of /opt/stack/data/nova/instances/2f25226c-952e-482b-b2c1-77384b67bbed_del complete
Jul 27 13:36:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-2dbb6700-32f2-4ff5-904f-5616db990b2d req-61adebf0-7405-40e3-9a19-8794fbee9422 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received event network-changed-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-2dbb6700-32f2-4ff5-904f-5616db990b2d req-61adebf0-7405-40e3-9a19-8794fbee9422 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Refreshing instance network info cache due to event network-changed-57f3731c-b1cc-416d-b717-2fdff9bac71c. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2dbb6700-32f2-4ff5-904f-5616db990b2d req-61adebf0-7405-40e3-9a19-8794fbee9422 service nova] Acquiring lock "refresh_cache-72a9344d-135a-4283-b42e-cf0e5fb4bc75" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2dbb6700-32f2-4ff5-904f-5616db990b2d req-61adebf0-7405-40e3-9a19-8794fbee9422 service nova] Acquired lock "refresh_cache-72a9344d-135a-4283-b42e-cf0e5fb4bc75" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG nova.network.neutron [req-2dbb6700-32f2-4ff5-904f-5616db990b2d req-61adebf0-7405-40e3-9a19-8794fbee9422 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Refreshing network info cache for port 57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:36:25 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 2f25226c-952e-482b-b2c1-77384b67bbed could not be found.
Jul 27 13:36:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIPfQUrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:25 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc5ea72-a94f-4c29-b994-d27df1578bd1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:36:25 user nova-compute[70914]: No targets found.
Jul 27 13:36:25 user nova-compute[70914]: iSNS:
Jul 27 13:36:25 user nova-compute[70914]: No targets found.
Jul 27 13:36:25 user nova-compute[70914]: STATIC:
Jul 27 13:36:25 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:36:25 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:36:25 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:36:25 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:36:25 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:36:25 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:36:25 user nova-compute[70914]: FIRMWARE:
Jul 27 13:36:25 user nova-compute[70914]: No targets found.
Jul 27 13:36:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:36:25 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:36:25 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2671be9-6d65-4b9a-a3f6-85c09883f245]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1267a4-339e-4e69-899a-263b404548b2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:25 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:25 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c1813aef0>, {}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Disconnecting from: [] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] <== disconnect_volume: return (94ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG nova.network.neutron [req-2dbb6700-32f2-4ff5-904f-5616db990b2d req-61adebf0-7405-40e3-9a19-8794fbee9422 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Updated VIF entry in instance network info cache for port 57f3731c-b1cc-416d-b717-2fdff9bac71c. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG nova.network.neutron [req-2dbb6700-32f2-4ff5-904f-5616db990b2d req-61adebf0-7405-40e3-9a19-8794fbee9422 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Updating instance_info_cache with network_info: [{"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2dbb6700-32f2-4ff5-904f-5616db990b2d req-61adebf0-7405-40e3-9a19-8794fbee9422 service nova] Releasing lock "refresh_cache-72a9344d-135a-4283-b42e-cf0e5fb4bc75" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Stashing vm_state: active {{(pid=70914) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-07f9a933-a8ca-4ded-8176-814df6ca45bf req-25e4eabb-3575-4183-bd4e-5cb73b8a1a49 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-07f9a933-a8ca-4ded-8176-814df6ca45bf req-25e4eabb-3575-4183-bd4e-5cb73b8a1a49 service nova] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-07f9a933-a8ca-4ded-8176-814df6ca45bf req-25e4eabb-3575-4183-bd4e-5cb73b8a1a49 service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-07f9a933-a8ca-4ded-8176-814df6ca45bf req-25e4eabb-3575-4183-bd4e-5cb73b8a1a49 service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-07f9a933-a8ca-4ded-8176-814df6ca45bf req-25e4eabb-3575-4183-bd4e-5cb73b8a1a49 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] No waiting events found dispatching network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:26 user nova-compute[70914]: WARNING nova.compute.manager [req-07f9a933-a8ca-4ded-8176-814df6ca45bf req-25e4eabb-3575-4183-bd4e-5cb73b8a1a49 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received unexpected event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 for instance with vm_state active and task_state rebuilding.
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Preparing to wait for external event volume-reimaged-d782ed7b-88de-430e-af81-93eb97c7ec68 {{(pid=70914) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'pci_requests' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:36:26 user nova-compute[70914]: INFO nova.compute.claims [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Claim successful on node user
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'resources' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'pci_devices' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:26 user nova-compute[70914]: INFO nova.compute.resource_tracker [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating resource usage from migration 30e73217-e7e5-410a-acb8-cd55480be645
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.653s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:26 user nova-compute[70914]: INFO nova.compute.manager [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Migrating
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquired lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:36:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'info_cache' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:26 user nova-compute[70914]: INFO nova.compute.rpcapi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 27 13:36:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquired lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG nova.network.neutron [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG nova.network.neutron [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating instance_info_cache with network_info: [{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Releasing lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:27 user nova-compute[70914]: INFO nova.compute.manager [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Terminating instance
Jul 27 13:36:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updating instance_info_cache with network_info: [{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Releasing lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:36:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Starting migrate_disk_and_power_off {{(pid=70914) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 27 13:36:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance destroyed successfully.
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'resources' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1253144734',display_name='tempest-AttachVolumeTestJSON-server-1253144734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1253144734',id=6,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATTI1RFyfQ2PRv5NB5cEM2tkF6yPM7cRAOJeCVPdJukiYvV0GqTPHVKc2LLrkmUe7gAf9AX0WCEnPmbS46UKi6r5ob0VnyeUfGZfj+EtT1Nf6CADr6H3u6d7f2/M6ZW3A==',key_name='tempest-keypair-1952109515',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-k0nq37r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_vif [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e9e022a-7a, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: INFO os_vif [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a')
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzyovJCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:28 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d825cca6-8d51-4a7d-a153-543e0aae760a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:36:28 user nova-compute[70914]: No targets found.
Jul 27 13:36:28 user nova-compute[70914]: iSNS:
Jul 27 13:36:28 user nova-compute[70914]: No targets found.
Jul 27 13:36:28 user nova-compute[70914]: STATIC:
Jul 27 13:36:28 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:36:28 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:36:28 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:36:28 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:36:28 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:36:28 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:36:28 user nova-compute[70914]: FIRMWARE:
Jul 27 13:36:28 user nova-compute[70914]: No targets found.
Jul 27 13:36:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:36:28 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:36:28 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2099c73e-2cea-4981-938d-ea9bde7031ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[225c1bd9-6360-4168-a38f-7ffea58d824e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:28 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:28 user nova-compute[70914]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c186bd5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4'): ({'sde'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Removing single pathed devices sde {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d020b6db-8488-4f78-a8f0-e877c8536404]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2578036-08ad-4776-bb0e-e5c7efabd61a]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flushing IO for device /dev/sde {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f041bf3-c268-4046-94ab-5676d42ba3cf]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.074s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f4964-0bc4-4f82-9900-97b614e71570]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2cd454-c617-472d-bf69-1f36b023ca74]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe246c2-0eeb-43bb-a2b1-8b9b7718663a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260]
Jul 27 13:36:28 user nova-compute[70914]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260] successful.
Jul 27 13:36:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c52fb4f-c97b-485b-a5d9-dd46ce3b139e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== disconnect_volume: return (393ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Start _get_guest_xml network_info=[{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'f4471c17-a97a-4d18-bda8-6455d6725445', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzyovJCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5', 'attached_at': '', 'detached_at': '', 'volume_id': '216beadf-a53f-4a8f-afbd-87ee5dea9fb4', 'serial': '216beadf-a53f-4a8f-afbd-87ee5dea9fb4'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'numa_topology' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-7643e3ce-6962-4c1b-9fcb-094cdda16ded req-dea2cd3f-984b-4f8e-818e-12dbcaae8a27 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received event network-vif-unplugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7643e3ce-6962-4c1b-9fcb-094cdda16ded req-dea2cd3f-984b-4f8e-818e-12dbcaae8a27 service nova] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7643e3ce-6962-4c1b-9fcb-094cdda16ded req-dea2cd3f-984b-4f8e-818e-12dbcaae8a27 service nova] Lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7643e3ce-6962-4c1b-9fcb-094cdda16ded req-dea2cd3f-984b-4f8e-818e-12dbcaae8a27 service nova] Lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-7643e3ce-6962-4c1b-9fcb-094cdda16ded req-dea2cd3f-984b-4f8e-818e-12dbcaae8a27 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] No waiting events found dispatching network-vif-unplugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-7643e3ce-6962-4c1b-9fcb-094cdda16ded req-dea2cd3f-984b-4f8e-818e-12dbcaae8a27 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received event network-vif-unplugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:36:28 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:36:28 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzyovJCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:28 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:28 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:28 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f00a0d1-f887-4a69-92d3-4ef85204d10e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:36:28 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d7eb77-a0aa-4e46-a7ef-64f19635179c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4] added
Jul 27 13:36:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b005631e-fd7d-4668-8d75-67d5cc028262]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2e7847-f2dc-4e1e-9ab0-ddab8265638e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nzyovJCx {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nzyovJCx" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a25a03f-cf3f-4a7f-84b1-5c680558e7ee]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nzyovJCx'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[14912ba2-2276-49ab-a051-bdad694f6418]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b585fc55-2eba-425d-9b21-f285a2d0d6bc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[43489dfa-13f5-48d4-8bf9-a299d709c2c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260]
Jul 27 13:36:28 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260] successful.
Jul 27 13:36:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7f17bb-1989-4723-ac29-457fa459e56b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e19c35e-5209-4122-90a7-90a4d9dbc615]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:28 user nova-compute[70914]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:28 user nova-compute[70914]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:36:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[92285593-3a3b-4286-846a-3d4d1ed7e2bc]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzyovJCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:29 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Instance destroyed successfully.
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.objects.instance [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lazy-loading 'resources' on Instance uuid 64c90716-f424-4909-92ad-958a04f5b5a1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-797082345',display_name='tempest-TestVolumeSwap-server-797082345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-797082345',id=10,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8KlQ3pzcjPXsQ0JOERls5oAyFZqK43MLioNtFATzNlsSEPE5L3fx9LPplR7tgRQPn10e5lWPNFD90F8iQb82kyfv7LtKzTxPf/6t1VdKm40MYSfsYAbcbB+8DGZ0CM/A==',key_name='tempest-keypair-1136706634',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='913df7f1d874417d8950295bc73d23f8',ramdisk_id='',reservation_id='r-nvidzjyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-831296',owner_user_name='tempest-TestVolumeSwap-831296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0dde816758840efad2e0217f62e1fa3',uuid=64c90716-f424-4909-92ad-958a04f5b5a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Converting VIF {"id": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "address": "fa:16:3e:db:b4:20", "network": {"id": "eb25c627-6803-430a-b1e8-3606b16d2f7d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-151333354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913df7f1d874417d8950295bc73d23f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e00cc5-18", "ovs_interfaceid": "e2e00cc5-18ce-41df-869a-8bb12c7a1d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:b4:20,bridge_name='br-int',has_traffic_filtering=True,id=e2e00cc5-18ce-41df-869a-8bb12c7a1d37,network=Network(eb25c627-6803-430a-b1e8-3606b16d2f7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e00cc5-18') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG os_vif [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:b4:20,bridge_name='br-int',has_traffic_filtering=True,id=e2e00cc5-18ce-41df-869a-8bb12c7a1d37,network=Network(eb25c627-6803-430a-b1e8-3606b16d2f7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e00cc5-18') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2e00cc5-18, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:29 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance destroyed successfully.
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1925007786',display_name='tempest-ServerActionsTestOtherB-server-1925007786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1925007786',id=5,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHExeREDDPpeeto4dRdX/RKJZ83dPJH4sXgXTDLxmQ+8ZlOJR2MBG7t/gorV67US4l275/41OOOBwoDR8FgADW9jHIAHwwSPLUWO/b4tEzLREH2uqa5IWe2ftSKsaPh2Hw==',key_name='tempest-keypair-168588775',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a180220b142349188245dd88298da020',ramdisk_id='',reservation_id='r-so1tb3rb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-874236545',owner_user_name='tempest-ServerActionsTestOtherB-874236545-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:36:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe9d73d3e87c4ad4a1ff9afb4ee6a9b0',uuid=38108984-8bd8-49b6-9111-33c084a5a16a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-784097649-network", "vif_mac": "fa:16:3e:5c:af:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converting VIF {"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-784097649-network", "vif_mac": "fa:16:3e:5c:af:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG os_vif [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae2390d8-70, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:29 user nova-compute[70914]: INFO os_vif [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:b4:20,bridge_name='br-int',has_traffic_filtering=True,id=e2e00cc5-18ce-41df-869a-8bb12c7a1d37,network=Network(eb25c627-6803-430a-b1e8-3606b16d2f7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e00cc5-18')
Jul 27 13:36:29 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Deleting instance files /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1_del
Jul 27 13:36:29 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Deletion of /opt/stack/data/nova/instances/64c90716-f424-4909-92ad-958a04f5b5a1_del complete
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:36:29 user nova-compute[70914]: INFO os_vif [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70')
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:29 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:36:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:29 user nova-compute[70914]: INFO nova.compute.manager [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Took 1.40 seconds to destroy the instance on the hypervisor.
Jul 27 13:36:29 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:36:29 user nova-compute[70914]: INFO nova.compute.claims [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Claim successful on node user
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26561333930363262', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561333930363262', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.845s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9b237d-cef2-40bc-9aeb-e1e413f4714e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:36:30 user nova-compute[70914]: No targets found.
Jul 27 13:36:30 user nova-compute[70914]: iSNS:
Jul 27 13:36:30 user nova-compute[70914]: No targets found.
Jul 27 13:36:30 user nova-compute[70914]: STATIC:
Jul 27 13:36:30 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:36:30 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:36:30 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:36:30 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:36:30 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:36:30 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:36:30 user nova-compute[70914]: FIRMWARE:
Jul 27 13:36:30 user nova-compute[70914]: No targets found.
Jul 27 13:36:30 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:36:30 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:36:30 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1253144734',display_name='tempest-AttachVolumeTestJSON-server-1253144734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1253144734',id=6,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATTI1RFyfQ2PRv5NB5cEM2tkF6yPM7cRAOJeCVPdJukiYvV0GqTPHVKc2LLrkmUe7gAf9AX0WCEnPmbS46UKi6r5ob0VnyeUfGZfj+EtT1Nf6CADr6H3u6d7f2/M6ZW3A==',key_name='tempest-keypair-1952109515',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-k0nq37r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'pci_devices' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[929ca67f-fa23-4277-b6a4-681c6397cf0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:36:30 user nova-compute[70914]:   <uuid>bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5</uuid>
Jul 27 13:36:30 user nova-compute[70914]:   <name>instance-00000006</name>
Jul 27 13:36:30 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:36:30 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:36:30 user nova-compute[70914]:   <metadata>
Jul 27 13:36:30 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:36:30 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:36:30 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeTestJSON-server-1253144734</nova:name>
Jul 27 13:36:30 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:36:28</nova:creationTime>
Jul 27 13:36:30 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:36:30 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:36:30 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:36:30 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:36:30 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:36:30 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:36:30 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:36:30 user nova-compute[70914]:       <nova:owner>
Jul 27 13:36:30 user nova-compute[70914]:         <nova:user uuid="7e9e3e0bd86140ada9edb906a16e4784">tempest-AttachVolumeTestJSON-366868791-project-member</nova:user>
Jul 27 13:36:30 user nova-compute[70914]:         <nova:project uuid="b0b9d12319d046088ca51fc23be9bb21">tempest-AttachVolumeTestJSON-366868791</nova:project>
Jul 27 13:36:30 user nova-compute[70914]:       </nova:owner>
Jul 27 13:36:30 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:36:30 user nova-compute[70914]:       <nova:ports>
Jul 27 13:36:30 user nova-compute[70914]:         <nova:port uuid="3e9e022a-7a8b-42ed-b88f-2c32b880ee78">
Jul 27 13:36:30 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 13:36:30 user nova-compute[70914]:         </nova:port>
Jul 27 13:36:30 user nova-compute[70914]:       </nova:ports>
Jul 27 13:36:30 user nova-compute[70914]:     </nova:instance>
Jul 27 13:36:30 user nova-compute[70914]:   </metadata>
Jul 27 13:36:30 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:36:30 user nova-compute[70914]:     <system>
Jul 27 13:36:30 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:36:30 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:36:30 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:36:30 user nova-compute[70914]:       <entry name="serial">bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5</entry>
Jul 27 13:36:30 user nova-compute[70914]:       <entry name="uuid">bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5</entry>
Jul 27 13:36:30 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:36:30 user nova-compute[70914]:     </system>
Jul 27 13:36:30 user nova-compute[70914]:   </sysinfo>
Jul 27 13:36:30 user nova-compute[70914]:   <os>
Jul 27 13:36:30 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:36:30 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:36:30 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:36:30 user nova-compute[70914]:   </os>
Jul 27 13:36:30 user nova-compute[70914]:   <features>
Jul 27 13:36:30 user nova-compute[70914]:     <acpi/>
Jul 27 13:36:30 user nova-compute[70914]:     <apic/>
Jul 27 13:36:30 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:36:30 user nova-compute[70914]:   </features>
Jul 27 13:36:30 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:36:30 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:36:30 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:36:30 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:36:30 user nova-compute[70914]:   </clock>
Jul 27 13:36:30 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:36:30 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:36:30 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:36:30 user nova-compute[70914]:   </cpu>
Jul 27 13:36:30 user nova-compute[70914]:   <devices>
Jul 27 13:36:30 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:36:30 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:36:30 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk"/>
Jul 27 13:36:30 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:36:30 user nova-compute[70914]:     </disk>
Jul 27 13:36:30 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:36:30 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:36:30 user nova-compute[70914]:       <source dev="/dev/sdc"/>
Jul 27 13:36:30 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:36:30 user nova-compute[70914]:       <serial>216beadf-a53f-4a8f-afbd-87ee5dea9fb4</serial>
Jul 27 13:36:30 user nova-compute[70914]:     </disk>
Jul 27 13:36:30 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:36:30 user nova-compute[70914]:       <mac address="fa:16:3e:a7:0c:e4"/>
Jul 27 13:36:30 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:36:30 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:36:30 user nova-compute[70914]:       <target dev="tap3e9e022a-7a"/>
Jul 27 13:36:30 user nova-compute[70914]:     </interface>
Jul 27 13:36:30 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:36:30 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/console.log" append="off"/>
Jul 27 13:36:30 user nova-compute[70914]:     </serial>
Jul 27 13:36:30 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:36:30 user nova-compute[70914]:     <video>
Jul 27 13:36:30 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:36:30 user nova-compute[70914]:     </video>
Jul 27 13:36:30 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:36:30 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:36:30 user nova-compute[70914]:     </rng>
Jul 27 13:36:30 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:36:30 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:36:30 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:36:30 user nova-compute[70914]:     </memballoon>
Jul 27 13:36:30 user nova-compute[70914]:   </devices>
Jul 27 13:36:30 user nova-compute[70914]: </domain>
Jul 27 13:36:30 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[56279d45-9de6-4c38-aedc-09322c23fe3f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:30 user nova-compute[70914]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:30 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:30 user nova-compute[70914]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:30 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c381a8af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1afce0-b221-40d0-911e-70f18e62fd11]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffd9f73-f47a-487a-98ce-9a36548c0d39]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9919944-e27f-4459-8365-693823b9f744]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f6b53d-ed85-4ffb-81d2-a8a0941ee670]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0461bff6-e88b-4e3d-bf77-1f6e5c867745]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a482a-278f-437e-8c88-c786890f75cd]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]
Jul 27 13:36:30 user nova-compute[70914]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.
Jul 27 13:36:30 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'trusted_certs' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dedaf91-16b0-415b-87fe-aa1fe344ddcc]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.824s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.536s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] <== disconnect_volume: return (1381ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received event network-vif-plugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] Acquiring lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] Lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] Lock "64c90716-f424-4909-92ad-958a04f5b5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] No waiting events found dispatching network-vif-plugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:30 user nova-compute[70914]: WARNING nova.compute.manager [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received unexpected event network-vif-plugged-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 for instance with vm_state active and task_state deleting.
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:30 user nova-compute[70914]: WARNING nova.compute.manager [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state active and task_state resize_migrating.
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:30 user nova-compute[70914]: WARNING nova.compute.manager [req-86e4a3ff-0167-460f-9913-296f75273ae4 req-c4c4c060-4851-4b70-89fd-ff6729f2bc47 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state active and task_state resize_migrating.
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-9b823ef3-cb1b-476f-9c7c-5d2010987493 req-e5434bed-5835-44c2-a104-5c894b6c656b service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Received event network-vif-deleted-e2e00cc5-18ce-41df-869a-8bb12c7a1d37 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:30 user nova-compute[70914]: INFO nova.compute.manager [req-9b823ef3-cb1b-476f-9c7c-5d2010987493 req-e5434bed-5835-44c2-a104-5c894b6c656b service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Neutron deleted interface e2e00cc5-18ce-41df-869a-8bb12c7a1d37; detaching it from the instance and deleting it from the info cache
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.network.neutron [req-9b823ef3-cb1b-476f-9c7c-5d2010987493 req-e5434bed-5835-44c2-a104-5c894b6c656b service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.248s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:36:30 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Took 1.54 seconds to deallocate network for instance.
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-9b823ef3-cb1b-476f-9c7c-5d2010987493 req-e5434bed-5835-44c2-a104-5c894b6c656b service nova] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Detach interface failed, port_id=e2e00cc5-18ce-41df-869a-8bb12c7a1d37, reason: Instance 64c90716-f424-4909-92ad-958a04f5b5a1 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Cannot resize image /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'migration_context' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1253144734',display_name='tempest-AttachVolumeTestJSON-server-1253144734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1253144734',id=6,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATTI1RFyfQ2PRv5NB5cEM2tkF6yPM7cRAOJeCVPdJukiYvV0GqTPHVKc2LLrkmUe7gAf9AX0WCEnPmbS46UKi6r5ob0VnyeUfGZfj+EtT1Nf6CADr6H3u6d7f2/M6ZW3A==',key_name='tempest-keypair-1952109515',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-k0nq37r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG os_vif [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:36:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Creating image(s)
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG nova.policy [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '461c5809f98c42daa7520c1bd0477ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03eaeefb7bc34913b18c81eb68c2e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e9e022a-7a, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e9e022a-7a, col_values=(('external_ids', {'iface-id': '3e9e022a-7a8b-42ed-b88f-2c32b880ee78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:0c:e4', 'vm-uuid': 'bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a_resize/disk /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:31 user nova-compute[70914]: INFO os_vif [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a')
Jul 27 13:36:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.189s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.167s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.260s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk 1073741824" returned: 0 in 0.080s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.167s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Checking if we can resize image /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:31 user nova-compute[70914]: INFO nova.compute.manager [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attaching volume 7e0db927-7ad2-463c-b9be-2b841e170cc7 to /dev/vdb
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "cp -r /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a_resize/disk /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk" returned: 0 in 0.643s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a_resize/disk.info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk.info {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG os_brick.utils [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "cp -r /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a_resize/disk.info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk.info" returned: 0 in 0.074s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Cannot resize image /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'migration_context' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd6001-c793-49fb-b326-e059d4708aca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Ensure instance console log exists: /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0034c398-3d2e-4887-9a55-ccf88bcdc0af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ca6cc7-7ba5-4ee9-9381-7ce3f13f6ab5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e057c5-9dd0-49e4-8189-6f09d535bb99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:36:31 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:36:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f57499-0558-4274-9163-7da19a9f8997]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG os_brick.utils [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Updating existing volume attachment record: 76478eaf-bfff-4c50-9376-85dc8da9691a {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:36:31 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.111s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Successfully created port: 7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:36:32 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Deleted allocations for instance 64c90716-f424-4909-92ad-958a04f5b5a1
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-35618858-b5a8-4a2f-9c1d-49b9da9980d2 tempest-TestVolumeSwap-831296 tempest-TestVolumeSwap-831296-project-member] Lock "64c90716-f424-4909-92ad-958a04f5b5a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.373s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:32 user nova-compute[70914]: WARNING nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state active and task_state resize_migrating.
Jul 27 13:36:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:32 user nova-compute[70914]: WARNING nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state active and task_state resize_migrating.
Jul 27 13:36:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:32 user nova-compute[70914]: WARNING nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state active and task_state resize_migrating.
Jul 27 13:36:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:32 user nova-compute[70914]: WARNING nova.compute.manager [req-63eed882-90b9-43af-b337-15d23317afe0 req-940fae46-eabd-4ffc-b3b4-15414286f5f5 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state active and task_state resize_migrating.
Jul 27 13:36:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Port ae2390d8-702c-478a-8f63-ff3c36403dc3 binding to destination host user is already ACTIVE {{(pid=70914) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.006s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquired lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Successfully updated port: 7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquired lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-0083db3c-a83c-43bb-8ed7-7e7b8133a6c2 req-2183b621-f84d-48ce-8372-e4acd6254893 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-changed-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-0083db3c-a83c-43bb-8ed7-7e7b8133a6c2 req-2183b621-f84d-48ce-8372-e4acd6254893 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Refreshing instance network info cache due to event network-changed-7c115254-d063-49fe-b94c-e7a22b8ccb31. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0083db3c-a83c-43bb-8ed7-7e7b8133a6c2 req-2183b621-f84d-48ce-8372-e4acd6254893 service nova] Acquiring lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.network.neutron [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating instance_info_cache with network_info: [{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Releasing lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG os_brick.utils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7611d701-a6de-4987-a983-ddf709d6899a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdb28a9-e6cd-4973-b8d2-13ced7f1ee5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e106707-afec-4ccc-a1fe-db2dec8724c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f7f68d-f602-4ed2-92f6-9db7a24a6800]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:36:34 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[468658f5-dac4-4a84-8c74-6e777fc017bb]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG os_brick.utils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating instance_info_cache with network_info: [{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Releasing lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Instance network_info: |[{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0083db3c-a83c-43bb-8ed7-7e7b8133a6c2 req-2183b621-f84d-48ce-8372-e4acd6254893 service nova] Acquired lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.network.neutron [req-0083db3c-a83c-43bb-8ed7-7e7b8133a6c2 req-2183b621-f84d-48ce-8372-e4acd6254893 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Refreshing network info cache for port 7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Start _get_guest_xml network_info=[{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:36:34 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:36:34 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1913153645',display_name='tempest-ServerStableDeviceRescueTest-server-1913153645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1913153645',id=16,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZtuqdDZDWOo97xKSb50o/8caWeMVr1tpEgfVE3erZUrnk/Hj4h9xffFcTwfYQRu4cXbjx+cdPga1/B+bf3ZwFDBubo5FIMGXYw908pwMqhui2gKJnbtIQfYUegpcdxfw==',key_name='tempest-keypair-1364291766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03eaeefb7bc34913b18c81eb68c2e053',ramdisk_id='',reservation_id='r-z8urou9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-11916342',owner_user_name='tempest-ServerStableDeviceRescueTest-11916342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='461c5809f98c42daa7520c1bd0477ffd',uuid=509e7547-8472-4954-8fc6-a152e9667437,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Converting VIF {"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f4:cc,bridge_name='br-int',has_traffic_filtering=True,id=7c115254-d063-49fe-b94c-e7a22b8ccb31,network=Network(ca534528-e241-4a4c-9ee7-30b7a67170e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c115254-d0') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'pci_devices' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:36:34 user nova-compute[70914]:   <uuid>509e7547-8472-4954-8fc6-a152e9667437</uuid>
Jul 27 13:36:34 user nova-compute[70914]:   <name>instance-00000010</name>
Jul 27 13:36:34 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:36:34 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:36:34 user nova-compute[70914]:   <metadata>
Jul 27 13:36:34 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:36:34 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:36:34 user nova-compute[70914]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1913153645</nova:name>
Jul 27 13:36:34 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:36:34</nova:creationTime>
Jul 27 13:36:34 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:36:34 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:36:34 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:36:34 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:36:34 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:36:34 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:36:34 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:36:34 user nova-compute[70914]:       <nova:owner>
Jul 27 13:36:34 user nova-compute[70914]:         <nova:user uuid="461c5809f98c42daa7520c1bd0477ffd">tempest-ServerStableDeviceRescueTest-11916342-project-member</nova:user>
Jul 27 13:36:34 user nova-compute[70914]:         <nova:project uuid="03eaeefb7bc34913b18c81eb68c2e053">tempest-ServerStableDeviceRescueTest-11916342</nova:project>
Jul 27 13:36:34 user nova-compute[70914]:       </nova:owner>
Jul 27 13:36:34 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:36:34 user nova-compute[70914]:       <nova:ports>
Jul 27 13:36:34 user nova-compute[70914]:         <nova:port uuid="7c115254-d063-49fe-b94c-e7a22b8ccb31">
Jul 27 13:36:34 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 13:36:34 user nova-compute[70914]:         </nova:port>
Jul 27 13:36:34 user nova-compute[70914]:       </nova:ports>
Jul 27 13:36:34 user nova-compute[70914]:     </nova:instance>
Jul 27 13:36:34 user nova-compute[70914]:   </metadata>
Jul 27 13:36:34 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:36:34 user nova-compute[70914]:     <system>
Jul 27 13:36:34 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:36:34 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:36:34 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:36:34 user nova-compute[70914]:       <entry name="serial">509e7547-8472-4954-8fc6-a152e9667437</entry>
Jul 27 13:36:34 user nova-compute[70914]:       <entry name="uuid">509e7547-8472-4954-8fc6-a152e9667437</entry>
Jul 27 13:36:34 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:36:34 user nova-compute[70914]:     </system>
Jul 27 13:36:34 user nova-compute[70914]:   </sysinfo>
Jul 27 13:36:34 user nova-compute[70914]:   <os>
Jul 27 13:36:34 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:36:34 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:36:34 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:36:34 user nova-compute[70914]:   </os>
Jul 27 13:36:34 user nova-compute[70914]:   <features>
Jul 27 13:36:34 user nova-compute[70914]:     <acpi/>
Jul 27 13:36:34 user nova-compute[70914]:     <apic/>
Jul 27 13:36:34 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:36:34 user nova-compute[70914]:   </features>
Jul 27 13:36:34 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:36:34 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:36:34 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:36:34 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:36:34 user nova-compute[70914]:   </clock>
Jul 27 13:36:34 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:36:34 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:36:34 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:36:34 user nova-compute[70914]:   </cpu>
Jul 27 13:36:34 user nova-compute[70914]:   <devices>
Jul 27 13:36:34 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:36:34 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:36:34 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk"/>
Jul 27 13:36:34 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:36:34 user nova-compute[70914]:     </disk>
Jul 27 13:36:34 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:36:34 user nova-compute[70914]:       <mac address="fa:16:3e:8b:f4:cc"/>
Jul 27 13:36:34 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:36:34 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:36:34 user nova-compute[70914]:       <target dev="tap7c115254-d0"/>
Jul 27 13:36:34 user nova-compute[70914]:     </interface>
Jul 27 13:36:34 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:36:34 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/console.log" append="off"/>
Jul 27 13:36:34 user nova-compute[70914]:     </serial>
Jul 27 13:36:34 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:36:34 user nova-compute[70914]:     <video>
Jul 27 13:36:34 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:36:34 user nova-compute[70914]:     </video>
Jul 27 13:36:34 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:36:34 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:36:34 user nova-compute[70914]:     </rng>
Jul 27 13:36:34 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:36:34 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:36:34 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:36:34 user nova-compute[70914]:     </memballoon>
Jul 27 13:36:34 user nova-compute[70914]:   </devices>
Jul 27 13:36:34 user nova-compute[70914]: </domain>
Jul 27 13:36:34 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1913153645',display_name='tempest-ServerStableDeviceRescueTest-server-1913153645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1913153645',id=16,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZtuqdDZDWOo97xKSb50o/8caWeMVr1tpEgfVE3erZUrnk/Hj4h9xffFcTwfYQRu4cXbjx+cdPga1/B+bf3ZwFDBubo5FIMGXYw908pwMqhui2gKJnbtIQfYUegpcdxfw==',key_name='tempest-keypair-1364291766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03eaeefb7bc34913b18c81eb68c2e053',ramdisk_id='',reservation_id='r-z8urou9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-11916342',owner_user_name='tempest-ServerStableDeviceRescueTest-11916342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='461c5809f98c42daa7520c1bd0477ffd',uuid=509e7547-8472-4954-8fc6-a152e9667437,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Converting VIF {"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f4:cc,bridge_name='br-int',has_traffic_filtering=True,id=7c115254-d063-49fe-b94c-e7a22b8ccb31,network=Network(ca534528-e241-4a4c-9ee7-30b7a67170e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c115254-d0') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG os_vif [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f4:cc,bridge_name='br-int',has_traffic_filtering=True,id=7c115254-d063-49fe-b94c-e7a22b8ccb31,network=Network(ca534528-e241-4a4c-9ee7-30b7a67170e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c115254-d0') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c115254-d0, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c115254-d0, col_values=(('external_ids', {'iface-id': '7c115254-d063-49fe-b94c-e7a22b8ccb31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:f4:cc', 'vm-uuid': '509e7547-8472-4954-8fc6-a152e9667437'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:34 user nova-compute[70914]: INFO os_vif [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f4:cc,bridge_name='br-int',has_traffic_filtering=True,id=7c115254-d063-49fe-b94c-e7a22b8ccb31,network=Network(ca534528-e241-4a4c-9ee7-30b7a67170e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c115254-d0')
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] No VIF found with MAC fa:16:3e:8b:f4:cc, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:34 user nova-compute[70914]: WARNING nova.compute.manager [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state stopped and task_state powering-on.
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:34 user nova-compute[70914]: WARNING nova.compute.manager [req-04b04736-ed63-4006-9160-2601f562cacf req-d2d86db3-af1e-4996-ac84-be8700b7a0a0 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state stopped and task_state powering-on.
Jul 27 13:36:35 user nova-compute[70914]: DEBUG nova.network.neutron [req-0083db3c-a83c-43bb-8ed7-7e7b8133a6c2 req-2183b621-f84d-48ce-8372-e4acd6254893 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updated VIF entry in instance network info cache for port 7c115254-d063-49fe-b94c-e7a22b8ccb31. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:36:35 user nova-compute[70914]: DEBUG nova.network.neutron [req-0083db3c-a83c-43bb-8ed7-7e7b8133a6c2 req-2183b621-f84d-48ce-8372-e4acd6254893 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating instance_info_cache with network_info: [{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0083db3c-a83c-43bb-8ed7-7e7b8133a6c2 req-2183b621-f84d-48ce-8372-e4acd6254893 service nova] Releasing lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:36:35 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464995.5771115, bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:35 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] VM Resumed (Lifecycle Event)
Jul 27 13:36:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:36:35 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance rebooted successfully.
Jul 27 13:36:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f53981d8-b347-4c24-86c2-b0b3acfe005b tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:36:35 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 27 13:36:35 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690464995.5788035, bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:35 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] VM Started (Lifecycle Event)
Jul 27 13:36:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:36:35 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 27 13:36:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-21d523b6-4d65-4bd9-a31a-84f9434f9b23 req-d7055e2b-6476-43b2-a624-8cf41ee98da9 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-21d523b6-4d65-4bd9-a31a-84f9434f9b23 req-d7055e2b-6476-43b2-a624-8cf41ee98da9 service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-21d523b6-4d65-4bd9-a31a-84f9434f9b23 req-d7055e2b-6476-43b2-a624-8cf41ee98da9 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-21d523b6-4d65-4bd9-a31a-84f9434f9b23 req-d7055e2b-6476-43b2-a624-8cf41ee98da9 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-21d523b6-4d65-4bd9-a31a-84f9434f9b23 req-d7055e2b-6476-43b2-a624-8cf41ee98da9 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:36 user nova-compute[70914]: WARNING nova.compute.manager [req-21d523b6-4d65-4bd9-a31a-84f9434f9b23 req-d7055e2b-6476-43b2-a624-8cf41ee98da9 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state building and task_state spawning.
Jul 27 13:36:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:36:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.470s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-691f4574-b984-45da-9441-4d1b28be2b4f req-84150ced-4f99-4159-b548-caac8c668395 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-691f4574-b984-45da-9441-4d1b28be2b4f req-84150ced-4f99-4159-b548-caac8c668395 service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-691f4574-b984-45da-9441-4d1b28be2b4f req-84150ced-4f99-4159-b548-caac8c668395 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-691f4574-b984-45da-9441-4d1b28be2b4f req-84150ced-4f99-4159-b548-caac8c668395 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-691f4574-b984-45da-9441-4d1b28be2b4f req-84150ced-4f99-4159-b548-caac8c668395 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:38 user nova-compute[70914]: WARNING nova.compute.manager [req-691f4574-b984-45da-9441-4d1b28be2b4f req-84150ced-4f99-4159-b548-caac8c668395 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state building and task_state spawning.
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:39 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690464984.561849, 2f25226c-952e-482b-b2c1-77384b67bbed => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:39 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] VM Stopped (Lifecycle Event)
Jul 27 13:36:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-09591b4e-bee3-4ea9-b9f5-7e28061d7f07 None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465000.4319265, 509e7547-8472-4954-8fc6-a152e9667437 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] VM Resumed (Lifecycle Event)
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:36:40 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Instance spawned successfully.
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465000.4371827, 509e7547-8472-4954-8fc6-a152e9667437 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] VM Started (Lifecycle Event)
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:36:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:40 user nova-compute[70914]: INFO nova.compute.manager [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Took 9.80 seconds to spawn the instance on the hypervisor.
Jul 27 13:36:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:40 user nova-compute[70914]: INFO nova.compute.manager [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Took 11.25 seconds to build instance.
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a2c4d0fe-e93a-429e-90ab-0ca71f2592be tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.380s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:42 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:36:42 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7652MB free_disk=25.686668395996094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Applying migration context for instance 38108984-8bd8-49b6-9111-33c084a5a16a as it has an incoming, in-progress migration 30e73217-e7e5-410a-acb8-cd55480be645. Migration status is post-migrating {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 13:36:42 user nova-compute[70914]: INFO nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating resource usage from migration 30e73217-e7e5-410a-acb8-cd55480be645
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance d54b6163-cc14-44d4-91c6-d306168bb875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 2f25226c-952e-482b-b2c1-77384b67bbed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 5a33a308-264e-445b-a47e-1b62773b4d6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Migration 30e73217-e7e5-410a-acb8-cd55480be645 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 38108984-8bd8-49b6-9111-33c084a5a16a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 509e7547-8472-4954-8fc6-a152e9667437 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:36:42 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:36:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:36:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690464989.0707006, 64c90716-f424-4909-92ad-958a04f5b5a1 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:44 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] VM Stopped (Lifecycle Event)
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-726613ed-6db6-4b11-a11f-5e8286e059c3 None None] [instance: 64c90716-f424-4909-92ad-958a04f5b5a1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690464989.1115098, 38108984-8bd8-49b6-9111-33c084a5a16a => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:44 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] VM Stopped (Lifecycle Event)
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-94a697db-c80d-4ada-ab48-a29a786b4e0c None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-94a697db-c80d-4ada-ab48-a29a786b4e0c None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:36:44 user nova-compute[70914]: INFO nova.compute.manager [None req-94a697db-c80d-4ada-ab48-a29a786b4e0c None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 13:36:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updating instance_info_cache with network_info: [{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Starting finish_migration {{(pid=70914) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance directory exists: not creating {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 13:36:44 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Creating image(s)
Jul 27 13:36:44 user nova-compute[70914]: DEBUG nova.objects.instance [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'trusted_certs' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.176s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk. size=21474836480 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk 21474836480 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk 21474836480" returned: 0 in 0.063s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Ensure instance console log exists: /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Start _get_guest_xml network_info=[{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-784097649-network", "vif_mac": "fa:16:3e:5c:af:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'd4570e57-897f-4d80-8312-29d4fa8c2c41', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '38108984-8bd8-49b6-9111-33c084a5a16a', 'attached_at': '2023-07-27T13:36:45.000000', 'detached_at': '', 'volume_id': '0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'serial': '0df6dc3b-018b-4dfb-afb9-6a2efcda4b98'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:36:45 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:36:45 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.objects.instance [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'vcpu_model' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:45 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:45 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:45 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d775536-d3f8-409c-9013-6c318905a3f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:36:45 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[676ae608-fcd5-4fff-a89c-84d905f4e16e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98] added
Jul 27 13:36:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[503c499e-e3a5-4161-adc2-11261b77b0d0]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[42166aa9-ba39-4025-aafb-531f0f04ed29]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgeofZBA {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgeofZBA" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[69475b21-398d-4043-9139-4253a589b0a4]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgeofZBA'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2051977-aadd-42ba-9762-f2128f7bd1eb]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6084ebf1-934e-4d7c-91c6-e661ee342b17]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:45 user nova-compute[70914]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:36:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:45 user nova-compute[70914]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:36:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e692da-c2b6-43ba-87db-48c37420df88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]
Jul 27 13:36:45 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.
Jul 27 13:36:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ada2551-7f9d-46f1-92e3-ca8167635a0e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e95fc3-4ace-464d-a2e2-87d9f11545cc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:45 user nova-compute[70914]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:36:45 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:45 user nova-compute[70914]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:36:45 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9c4081-8a23-480e-b33b-0d728ff18408]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:36:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:36:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23363353465353932', 'path': '/dev/sdd'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:46 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363353465353932', 'path': '/dev/sdd'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1925007786',display_name='tempest-ServerActionsTestOtherB-server-1925007786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1925007786',id=5,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHExeREDDPpeeto4dRdX/RKJZ83dPJH4sXgXTDLxmQ+8ZlOJR2MBG7t/gorV67US4l275/41OOOBwoDR8FgADW9jHIAHwwSPLUWO/b4tEzLREH2uqa5IWe2ftSKsaPh2Hw==',key_name='tempest-keypair-168588775',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a180220b142349188245dd88298da020',ramdisk_id='',reservation_id='r-so1tb3rb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-874236545',owner_user_name='tempest-ServerActionsTestOtherB-874236545-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:36:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe9d73d3e87c4ad4a1ff9afb4ee6a9b0',uuid=38108984-8bd8-49b6-9111-33c084a5a16a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-784097649-network", "vif_mac": "fa:16:3e:5c:af:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converting VIF {"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-784097649-network", "vif_mac": "fa:16:3e:5c:af:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:36:47 user nova-compute[70914]:   <uuid>38108984-8bd8-49b6-9111-33c084a5a16a</uuid>
Jul 27 13:36:47 user nova-compute[70914]:   <name>instance-00000005</name>
Jul 27 13:36:47 user nova-compute[70914]:   <memory>2097152</memory>
Jul 27 13:36:47 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:36:47 user nova-compute[70914]:   <metadata>
Jul 27 13:36:47 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:36:47 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:36:47 user nova-compute[70914]:       <nova:name>tempest-ServerActionsTestOtherB-server-1925007786</nova:name>
Jul 27 13:36:47 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:36:45</nova:creationTime>
Jul 27 13:36:47 user nova-compute[70914]:       <nova:flavor name="m1.small">
Jul 27 13:36:47 user nova-compute[70914]:         <nova:memory>2048</nova:memory>
Jul 27 13:36:47 user nova-compute[70914]:         <nova:disk>20</nova:disk>
Jul 27 13:36:47 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:36:47 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:36:47 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:36:47 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:36:47 user nova-compute[70914]:       <nova:owner>
Jul 27 13:36:47 user nova-compute[70914]:         <nova:user uuid="fe9d73d3e87c4ad4a1ff9afb4ee6a9b0">tempest-ServerActionsTestOtherB-874236545-project-member</nova:user>
Jul 27 13:36:47 user nova-compute[70914]:         <nova:project uuid="a180220b142349188245dd88298da020">tempest-ServerActionsTestOtherB-874236545</nova:project>
Jul 27 13:36:47 user nova-compute[70914]:       </nova:owner>
Jul 27 13:36:47 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:36:47 user nova-compute[70914]:       <nova:ports>
Jul 27 13:36:47 user nova-compute[70914]:         <nova:port uuid="ae2390d8-702c-478a-8f63-ff3c36403dc3">
Jul 27 13:36:47 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 13:36:47 user nova-compute[70914]:         </nova:port>
Jul 27 13:36:47 user nova-compute[70914]:       </nova:ports>
Jul 27 13:36:47 user nova-compute[70914]:     </nova:instance>
Jul 27 13:36:47 user nova-compute[70914]:   </metadata>
Jul 27 13:36:47 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:36:47 user nova-compute[70914]:     <system>
Jul 27 13:36:47 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:36:47 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:36:47 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:36:47 user nova-compute[70914]:       <entry name="serial">38108984-8bd8-49b6-9111-33c084a5a16a</entry>
Jul 27 13:36:47 user nova-compute[70914]:       <entry name="uuid">38108984-8bd8-49b6-9111-33c084a5a16a</entry>
Jul 27 13:36:47 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:36:47 user nova-compute[70914]:     </system>
Jul 27 13:36:47 user nova-compute[70914]:   </sysinfo>
Jul 27 13:36:47 user nova-compute[70914]:   <os>
Jul 27 13:36:47 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:36:47 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:36:47 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:36:47 user nova-compute[70914]:   </os>
Jul 27 13:36:47 user nova-compute[70914]:   <features>
Jul 27 13:36:47 user nova-compute[70914]:     <acpi/>
Jul 27 13:36:47 user nova-compute[70914]:     <apic/>
Jul 27 13:36:47 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:36:47 user nova-compute[70914]:   </features>
Jul 27 13:36:47 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:36:47 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:36:47 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:36:47 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:36:47 user nova-compute[70914]:   </clock>
Jul 27 13:36:47 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:36:47 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:36:47 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:36:47 user nova-compute[70914]:   </cpu>
Jul 27 13:36:47 user nova-compute[70914]:   <devices>
Jul 27 13:36:47 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:36:47 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:36:47 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk"/>
Jul 27 13:36:47 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:36:47 user nova-compute[70914]:     </disk>
Jul 27 13:36:47 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:36:47 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:36:47 user nova-compute[70914]:       <source dev="/dev/sdd"/>
Jul 27 13:36:47 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:36:47 user nova-compute[70914]:       <serial>0df6dc3b-018b-4dfb-afb9-6a2efcda4b98</serial>
Jul 27 13:36:47 user nova-compute[70914]:     </disk>
Jul 27 13:36:47 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:36:47 user nova-compute[70914]:       <mac address="fa:16:3e:5c:af:6f"/>
Jul 27 13:36:47 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:36:47 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:36:47 user nova-compute[70914]:       <target dev="tapae2390d8-70"/>
Jul 27 13:36:47 user nova-compute[70914]:     </interface>
Jul 27 13:36:47 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:36:47 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/console.log" append="off"/>
Jul 27 13:36:47 user nova-compute[70914]:     </serial>
Jul 27 13:36:47 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:36:47 user nova-compute[70914]:     <video>
Jul 27 13:36:47 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:36:47 user nova-compute[70914]:     </video>
Jul 27 13:36:47 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:36:47 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:36:47 user nova-compute[70914]:     </rng>
Jul 27 13:36:47 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:36:47 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:36:47 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:36:47 user nova-compute[70914]:     </memballoon>
Jul 27 13:36:47 user nova-compute[70914]:   </devices>
Jul 27 13:36:47 user nova-compute[70914]: </domain>
Jul 27 13:36:47 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1925007786',display_name='tempest-ServerActionsTestOtherB-server-1925007786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1925007786',id=5,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHExeREDDPpeeto4dRdX/RKJZ83dPJH4sXgXTDLxmQ+8ZlOJR2MBG7t/gorV67US4l275/41OOOBwoDR8FgADW9jHIAHwwSPLUWO/b4tEzLREH2uqa5IWe2ftSKsaPh2Hw==',key_name='tempest-keypair-168588775',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a180220b142349188245dd88298da020',ramdisk_id='',reservation_id='r-so1tb3rb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-874236545',owner_user_name='tempest-ServerActionsTestOtherB-874236545-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:36:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe9d73d3e87c4ad4a1ff9afb4ee6a9b0',uuid=38108984-8bd8-49b6-9111-33c084a5a16a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-784097649-network", "vif_mac": "fa:16:3e:5c:af:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converting VIF {"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-784097649-network", "vif_mac": "fa:16:3e:5c:af:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG os_vif [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae2390d8-70, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae2390d8-70, col_values=(('external_ids', {'iface-id': 'ae2390d8-702c-478a-8f63-ff3c36403dc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:af:6f', 'vm-uuid': '38108984-8bd8-49b6-9111-33c084a5a16a'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:47 user nova-compute[70914]: INFO os_vif [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70')
Jul 27 13:36:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:36:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] No VIF found with MAC fa:16:3e:5c:af:6f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-49633752-cfe7-41c0-9370-1796b7277e8f req-1de979bb-2bf0-4520-9241-c53a841c2810 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-49633752-cfe7-41c0-9370-1796b7277e8f req-1de979bb-2bf0-4520-9241-c53a841c2810 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-49633752-cfe7-41c0-9370-1796b7277e8f req-1de979bb-2bf0-4520-9241-c53a841c2810 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-49633752-cfe7-41c0-9370-1796b7277e8f req-1de979bb-2bf0-4520-9241-c53a841c2810 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-49633752-cfe7-41c0-9370-1796b7277e8f req-1de979bb-2bf0-4520-9241-c53a841c2810 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:49 user nova-compute[70914]: WARNING nova.compute.manager [req-49633752-cfe7-41c0-9370-1796b7277e8f req-1de979bb-2bf0-4520-9241-c53a841c2810 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state active and task_state resize_finish.
Jul 27 13:36:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-d1398e87-9521-4ef1-be29-59e93f8271fe req-82ed2bc9-ffc7-4f58-8d79-3c31bbccf67b service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event volume-reimaged-d782ed7b-88de-430e-af81-93eb97c7ec68 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d1398e87-9521-4ef1-be29-59e93f8271fe req-82ed2bc9-ffc7-4f58-8d79-3c31bbccf67b service nova] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d1398e87-9521-4ef1-be29-59e93f8271fe req-82ed2bc9-ffc7-4f58-8d79-3c31bbccf67b service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d1398e87-9521-4ef1-be29-59e93f8271fe req-82ed2bc9-ffc7-4f58-8d79-3c31bbccf67b service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-d1398e87-9521-4ef1-be29-59e93f8271fe req-82ed2bc9-ffc7-4f58-8d79-3c31bbccf67b service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Processing event volume-reimaged-d782ed7b-88de-430e-af81-93eb97c7ec68 {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGNihWHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:49 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:49 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:36:49 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9a4d0f-af81-4c0d-ae45-20e15b54cf4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:36:49 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:49 user nova-compute[70914]: INFO nova.virt.block_device [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Booting with volume d782ed7b-88de-430e-af81-93eb97c7ec68 at /dev/vda
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed12c64d-610b-49cd-95dc-93e69ea7d178]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7] added
Jul 27 13:36:49 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[80515886-3934-47b9-ab5e-480bb77cfe58]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.utils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[716c4f24-b863-4531-a485-bd818cb545ec]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGNihWHq {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[634104d6-77b5-4d81-b3a6-6ce11c39bd20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGNihWHq" returned: 0 in 0.030s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f367ed81-a1b1-4d26-9461-1e5b65ef6304]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2be7360-5377-4f25-a72f-66b5c98b4b96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rGNihWHq'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d81388-5e99-4bfe-b459-b01463a48f7f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[72707456-3061-46e7-87c0-c738582a3dd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa8291-0c9b-4391-9c94-274d54493e3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[306ad141-91c4-47fc-a0ae-8ea4606aa3a7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:50 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:50 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:50 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:50 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:36:50 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaf753e-8443-4ed9-803e-c3aac68c25b1]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.utils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Updating existing volume attachment record: 38ec2c0f-e2be-4568-a89e-04fcf8297ce9 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bc9e8b-244b-4a2a-bec0-d32cdf13bc39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7, portal: 172.16.0.220,3260]
Jul 27 13:36:50 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7, portal: 172.16.0.220,3260] successful.
Jul 27 13:36:50 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1145630c-24c2-4065-b42d-3c16831eeba3]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcbd7a5-d83d-4fc5-af2a-776b7778bac2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:50 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:50 user nova-compute[70914]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)
Jul 27 13:36:50 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:36:50 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:36:50 user nova-compute[70914]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)
Jul 27 13:36:50 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad7b71b-1d29-4dbe-994c-9010f7afc53c]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGNihWHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:36:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.517s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== connect_volume: return (1518ms) {'type': 'block', 'scsi_wwn': '23865646562346532', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865646562346532', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.objects.instance [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:36:51 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:36:51 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:36:51 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:36:51 user nova-compute[70914]:   <serial>7e0db927-7ad2-463c-b9be-2b841e170cc7</serial>
Jul 27 13:36:51 user nova-compute[70914]: </disk>
Jul 27 13:36:51 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-2e77000d-2c06-4714-8659-1c560b960563 req-a49969f0-ef5d-461c-b62a-fcbf382f548f service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2e77000d-2c06-4714-8659-1c560b960563 req-a49969f0-ef5d-461c-b62a-fcbf382f548f service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2e77000d-2c06-4714-8659-1c560b960563 req-a49969f0-ef5d-461c-b62a-fcbf382f548f service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2e77000d-2c06-4714-8659-1c560b960563 req-a49969f0-ef5d-461c-b62a-fcbf382f548f service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-2e77000d-2c06-4714-8659-1c560b960563 req-a49969f0-ef5d-461c-b62a-fcbf382f548f service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:36:51 user nova-compute[70914]: WARNING nova.compute.manager [req-2e77000d-2c06-4714-8659-1c560b960563 req-a49969f0-ef5d-461c-b62a-fcbf382f548f service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state active and task_state resize_finish.
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No VIF found with MAC fa:16:3e:a7:1a:64, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465011.8188977, 38108984-8bd8-49b6-9111-33c084a5a16a => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:51 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] VM Resumed (Lifecycle Event)
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:36:51 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance running successfully.
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Failed to set time: agent not configured {{(pid=70914) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-007c9d98-2722-4d47-9398-2c44436d41b6 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] finish_migration finished successfully. {{(pid=70914) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:36:51 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465011.821821, 38108984-8bd8-49b6-9111-33c084a5a16a => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:36:51 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] VM Started (Lifecycle Event)
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:36:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:36:51 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 13:36:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-72541a60-1d05-4dd1-93e3-d90f934cede2 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.323s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:36:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:36:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:00 user nova-compute[70914]: INFO nova.compute.manager [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Rescuing
Jul 27 13:37:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:37:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquired lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:37:00 user nova-compute[70914]: DEBUG nova.network.neutron [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:37:01 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Creating image(s)
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Ensure instance console log exists: /opt/stack/data/nova/instances/2f25226c-952e-482b-b2c1-77384b67bbed/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Start _get_guest_xml network_info=[{"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '38ec2c0f-e2be-4568-a89e-04fcf8297ce9', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIPfQUrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f25226c-952e-482b-b2c1-77384b67bbed', 'attached_at': '', 'detached_at': '', 'volume_id': 'd782ed7b-88de-430e-af81-93eb97c7ec68', 'serial': 'd782ed7b-88de-430e-af81-93eb97c7ec68'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:37:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 13:37:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f25226c-952e-482b-b2c1-77384b67bbed {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updating instance_info_cache with network_info: [{"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIPfQUrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:37:01 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:37:01 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:37:01 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Releasing lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafbeecc-6a4d-4307-93d7-23574afd5c8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:37:01 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d862ea7c-7c2c-44b8-8b02-460e6678424d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68] added
Jul 27 13:37:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffc82b1-ca8c-4c28-8a0d-b24aabf75f36]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eeb532a-ff38-405d-ac40-beee71700921]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIPfQUrp {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIPfQUrp" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8669b31-b4b2-4f87-b2ce-b52299bc9795]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VIPfQUrp'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e3b138-b690-4c4e-8584-47ca66dbc848]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4688a4-6743-48b4-bfe9-7f4c9f555358]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:37:01 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:37:01 user nova-compute[70914]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)
Jul 27 13:37:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:37:01 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:37:01 user nova-compute[70914]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)
Jul 27 13:37:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5a267f-71ae-4718-aabe-0892d8bae15d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260]
Jul 27 13:37:01 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260] successful.
Jul 27 13:37:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[94374de2-1c10-4071-9a29-de52003ca1e0]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[122f72e1-2eea-4ba3-8b13-4bc69a0d6dc6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:37:02 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:37:02 user nova-compute[70914]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)
Jul 27 13:37:02 user nova-compute[70914]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:37:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:37:02 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:37:02 user nova-compute[70914]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)
Jul 27 13:37:02 user nova-compute[70914]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:37:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a9e19c-b83a-487b-ae34-be199c895768]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIPfQUrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-f98c85cb-8425-4ee3-8bb3-306ba8cbbc4b req-adbcf900-a411-4ef4-9c1e-ae07cc47068d service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f98c85cb-8425-4ee3-8bb3-306ba8cbbc4b req-adbcf900-a411-4ef4-9c1e-ae07cc47068d service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f98c85cb-8425-4ee3-8bb3-306ba8cbbc4b req-adbcf900-a411-4ef4-9c1e-ae07cc47068d service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f98c85cb-8425-4ee3-8bb3-306ba8cbbc4b req-adbcf900-a411-4ef4-9c1e-ae07cc47068d service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-f98c85cb-8425-4ee3-8bb3-306ba8cbbc4b req-adbcf900-a411-4ef4-9c1e-ae07cc47068d service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:02 user nova-compute[70914]: WARNING nova.compute.manager [req-f98c85cb-8425-4ee3-8bb3-306ba8cbbc4b req-adbcf900-a411-4ef4-9c1e-ae07cc47068d service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state active and task_state rescuing.
Jul 27 13:37:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Instance destroyed successfully.
Jul 27 13:37:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Attempting rescue
Jul 27 13:37:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70914) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Instance directory exists: not creating {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 13:37:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Creating image(s)
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.224s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue" returned: 0 in 0.114s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'migration_context' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Start _get_guest_xml network_info=[{"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "vif_mac": "fa:16:3e:73:0e:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'resources' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:02 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'numa_topology' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:02 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:37:02 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1172859920',display_name='tempest-ServerRescueNegativeTestJSON-server-1172859920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1172859920',id=1,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-rf0p6iln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:32:40Z,user_data=None,user_id='a0d92b0b34814e75a7709e09e357be07',uuid=1b676522-c547-497a-9b3b-8436f85c7f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "vif_mac": "fa:16:3e:73:0e:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "vif_mac": "fa:16:3e:73:0e:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:0e:6b,bridge_name='br-int',has_traffic_filtering=True,id=15896fd3-c444-414b-81ae-8594251d3c8e,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15896fd3-c4') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.558s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] <== connect_volume: return (1560ms) {'type': 'block', 'scsi_wwn': '23530353766623730', 'path': '/dev/sde'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530353766623730', 'path': '/dev/sde'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:37:03 user nova-compute[70914]:   <uuid>1b676522-c547-497a-9b3b-8436f85c7f40</uuid>
Jul 27 13:37:03 user nova-compute[70914]:   <name>instance-00000001</name>
Jul 27 13:37:03 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:37:03 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:37:03 user nova-compute[70914]:   <metadata>
Jul 27 13:37:03 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:37:03 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1172859920</nova:name>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:37:02</nova:creationTime>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:37:03 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:37:03 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:owner>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:user uuid="a0d92b0b34814e75a7709e09e357be07">tempest-ServerRescueNegativeTestJSON-1275773337-project-member</nova:user>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:project uuid="097b177edc7249f798bca2c39a33394d">tempest-ServerRescueNegativeTestJSON-1275773337</nova:project>
Jul 27 13:37:03 user nova-compute[70914]:       </nova:owner>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:ports>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:port uuid="15896fd3-c444-414b-81ae-8594251d3c8e">
Jul 27 13:37:03 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:37:03 user nova-compute[70914]:         </nova:port>
Jul 27 13:37:03 user nova-compute[70914]:       </nova:ports>
Jul 27 13:37:03 user nova-compute[70914]:     </nova:instance>
Jul 27 13:37:03 user nova-compute[70914]:   </metadata>
Jul 27 13:37:03 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:37:03 user nova-compute[70914]:     <system>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="serial">1b676522-c547-497a-9b3b-8436f85c7f40</entry>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="uuid">1b676522-c547-497a-9b3b-8436f85c7f40</entry>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:37:03 user nova-compute[70914]:     </system>
Jul 27 13:37:03 user nova-compute[70914]:   </sysinfo>
Jul 27 13:37:03 user nova-compute[70914]:   <os>
Jul 27 13:37:03 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:37:03 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:37:03 user nova-compute[70914]:   </os>
Jul 27 13:37:03 user nova-compute[70914]:   <features>
Jul 27 13:37:03 user nova-compute[70914]:     <acpi/>
Jul 27 13:37:03 user nova-compute[70914]:     <apic/>
Jul 27 13:37:03 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:37:03 user nova-compute[70914]:   </features>
Jul 27 13:37:03 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:37:03 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:37:03 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:37:03 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:37:03 user nova-compute[70914]:   </clock>
Jul 27 13:37:03 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:37:03 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:37:03 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:37:03 user nova-compute[70914]:   </cpu>
Jul 27 13:37:03 user nova-compute[70914]:   <devices>
Jul 27 13:37:03 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:37:03 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:37:03 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue"/>
Jul 27 13:37:03 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:37:03 user nova-compute[70914]:     </disk>
Jul 27 13:37:03 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:37:03 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:37:03 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk"/>
Jul 27 13:37:03 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:37:03 user nova-compute[70914]:     </disk>
Jul 27 13:37:03 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:37:03 user nova-compute[70914]:       <mac address="fa:16:3e:73:0e:6b"/>
Jul 27 13:37:03 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:37:03 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:37:03 user nova-compute[70914]:       <target dev="tap15896fd3-c4"/>
Jul 27 13:37:03 user nova-compute[70914]:     </interface>
Jul 27 13:37:03 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:37:03 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/console.log" append="off"/>
Jul 27 13:37:03 user nova-compute[70914]:     </serial>
Jul 27 13:37:03 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:37:03 user nova-compute[70914]:     <video>
Jul 27 13:37:03 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:37:03 user nova-compute[70914]:     </video>
Jul 27 13:37:03 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:37:03 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:37:03 user nova-compute[70914]:     </rng>
Jul 27 13:37:03 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:37:03 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:37:03 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:37:03 user nova-compute[70914]:     </memballoon>
Jul 27 13:37:03 user nova-compute[70914]:   </devices>
Jul 27 13:37:03 user nova-compute[70914]: </domain>
Jul 27 13:37:03 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:37:03 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Instance destroyed successfully.
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1222468261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2055353492',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OojAdixfznGFq1DFKNCIKxcrjX+E9vG3RnHr9K0gfako8L+aQbe5jQFEZ9xGSZx+L1z6hfai/IJzJVF4i0/HETmmSR8l0MTYoqWjUkVS3bqQMlxlDM9T3JIc6tBeVwg==',key_name='tempest-keypair-666687196',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4c94597dacc420abba408e3b60f4a40',ramdisk_id='',reservation_id='r-wlsu70h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1997290170',owner_user_name='tempest-ServerActionsV293TestJSON-1997290170-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:36:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9279e1abc6946bc970fa3b2b2119c67',uuid=2f25226c-952e-482b-b2c1-77384b67bbed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converting VIF {"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:37:03 user nova-compute[70914]:   <uuid>2f25226c-952e-482b-b2c1-77384b67bbed</uuid>
Jul 27 13:37:03 user nova-compute[70914]:   <name>instance-0000000d</name>
Jul 27 13:37:03 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:37:03 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:37:03 user nova-compute[70914]:   <metadata>
Jul 27 13:37:03 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:37:03 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1222468261</nova:name>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:37:01</nova:creationTime>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:37:03 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:37:03 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:owner>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:user uuid="a9279e1abc6946bc970fa3b2b2119c67">tempest-ServerActionsV293TestJSON-1997290170-project-member</nova:user>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:project uuid="c4c94597dacc420abba408e3b60f4a40">tempest-ServerActionsV293TestJSON-1997290170</nova:project>
Jul 27 13:37:03 user nova-compute[70914]:       </nova:owner>
Jul 27 13:37:03 user nova-compute[70914]:       <nova:ports>
Jul 27 13:37:03 user nova-compute[70914]:         <nova:port uuid="ae2338c5-670a-42f8-999b-8e9fdbb83378">
Jul 27 13:37:03 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 13:37:03 user nova-compute[70914]:         </nova:port>
Jul 27 13:37:03 user nova-compute[70914]:       </nova:ports>
Jul 27 13:37:03 user nova-compute[70914]:     </nova:instance>
Jul 27 13:37:03 user nova-compute[70914]:   </metadata>
Jul 27 13:37:03 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:37:03 user nova-compute[70914]:     <system>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="serial">2f25226c-952e-482b-b2c1-77384b67bbed</entry>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="uuid">2f25226c-952e-482b-b2c1-77384b67bbed</entry>
Jul 27 13:37:03 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:37:03 user nova-compute[70914]:     </system>
Jul 27 13:37:03 user nova-compute[70914]:   </sysinfo>
Jul 27 13:37:03 user nova-compute[70914]:   <os>
Jul 27 13:37:03 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:37:03 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:37:03 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:37:03 user nova-compute[70914]:   </os>
Jul 27 13:37:03 user nova-compute[70914]:   <features>
Jul 27 13:37:03 user nova-compute[70914]:     <acpi/>
Jul 27 13:37:03 user nova-compute[70914]:     <apic/>
Jul 27 13:37:03 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:37:03 user nova-compute[70914]:   </features>
Jul 27 13:37:03 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:37:03 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:37:03 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:37:03 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:37:03 user nova-compute[70914]:   </clock>
Jul 27 13:37:03 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:37:03 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:37:03 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:37:03 user nova-compute[70914]:   </cpu>
Jul 27 13:37:03 user nova-compute[70914]:   <devices>
Jul 27 13:37:03 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:37:03 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:37:03 user nova-compute[70914]:       <source dev="/dev/sde"/>
Jul 27 13:37:03 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:37:03 user nova-compute[70914]:       <serial>d782ed7b-88de-430e-af81-93eb97c7ec68</serial>
Jul 27 13:37:03 user nova-compute[70914]:     </disk>
Jul 27 13:37:03 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:37:03 user nova-compute[70914]:       <mac address="fa:16:3e:c1:0d:fd"/>
Jul 27 13:37:03 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:37:03 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:37:03 user nova-compute[70914]:       <target dev="tapae2338c5-67"/>
Jul 27 13:37:03 user nova-compute[70914]:     </interface>
Jul 27 13:37:03 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:37:03 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/2f25226c-952e-482b-b2c1-77384b67bbed/console.log" append="off"/>
Jul 27 13:37:03 user nova-compute[70914]:     </serial>
Jul 27 13:37:03 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:37:03 user nova-compute[70914]:     <video>
Jul 27 13:37:03 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:37:03 user nova-compute[70914]:     </video>
Jul 27 13:37:03 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:37:03 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:37:03 user nova-compute[70914]:     </rng>
Jul 27 13:37:03 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:37:03 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:37:03 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:37:03 user nova-compute[70914]:     </memballoon>
Jul 27 13:37:03 user nova-compute[70914]:   </devices>
Jul 27 13:37:03 user nova-compute[70914]: </domain>
Jul 27 13:37:03 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1222468261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2055353492',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OojAdixfznGFq1DFKNCIKxcrjX+E9vG3RnHr9K0gfako8L+aQbe5jQFEZ9xGSZx+L1z6hfai/IJzJVF4i0/HETmmSR8l0MTYoqWjUkVS3bqQMlxlDM9T3JIc6tBeVwg==',key_name='tempest-keypair-666687196',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4c94597dacc420abba408e3b60f4a40',ramdisk_id='',reservation_id='r-wlsu70h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1997290170',owner_user_name='tempest-ServerActionsV293TestJSON-1997290170-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:36:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9279e1abc6946bc970fa3b2b2119c67',uuid=2f25226c-952e-482b-b2c1-77384b67bbed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converting VIF {"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG os_vif [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae2338c5-67, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae2338c5-67, col_values=(('external_ids', {'iface-id': 'ae2338c5-670a-42f8-999b-8e9fdbb83378', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:0d:fd', 'vm-uuid': '2f25226c-952e-482b-b2c1-77384b67bbed'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:03 user nova-compute[70914]: INFO os_vif [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67')
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No VIF found with MAC fa:16:3e:73:0e:6b, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] No VIF found with MAC fa:16:3e:c1:0d:fd, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:37:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:04 user nova-compute[70914]: WARNING nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state active and task_state rescuing.
Jul 27 13:37:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:04 user nova-compute[70914]: WARNING nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state active and task_state rescuing.
Jul 27 13:37:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:04 user nova-compute[70914]: WARNING nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state active and task_state rescuing.
Jul 27 13:37:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:04 user nova-compute[70914]: WARNING nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state active and task_state rescuing.
Jul 27 13:37:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:04 user nova-compute[70914]: WARNING nova.compute.manager [req-70d5e50b-bad0-443c-8bae-fa20a630bb9d req-abef3d2d-1ce5-4929-9b2f-c75e25bd9ebf service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state active and task_state rescuing.
Jul 27 13:37:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-52fed69c-b5c6-4709-8d27-37c616b3f03e req-b496dcf9-ed35-4e8c-ae01-7912d0068a9d service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-52fed69c-b5c6-4709-8d27-37c616b3f03e req-b496dcf9-ed35-4e8c-ae01-7912d0068a9d service nova] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-52fed69c-b5c6-4709-8d27-37c616b3f03e req-b496dcf9-ed35-4e8c-ae01-7912d0068a9d service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-52fed69c-b5c6-4709-8d27-37c616b3f03e req-b496dcf9-ed35-4e8c-ae01-7912d0068a9d service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-52fed69c-b5c6-4709-8d27-37c616b3f03e req-b496dcf9-ed35-4e8c-ae01-7912d0068a9d service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] No waiting events found dispatching network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:06 user nova-compute[70914]: WARNING nova.compute.manager [req-52fed69c-b5c6-4709-8d27-37c616b3f03e req-b496dcf9-ed35-4e8c-ae01-7912d0068a9d service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received unexpected event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 13:37:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-609f490e-baed-488f-9f10-3c1b496d6c4c req-e1bd3252-7d8c-42b0-bd65-53275e0ce1e0 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-609f490e-baed-488f-9f10-3c1b496d6c4c req-e1bd3252-7d8c-42b0-bd65-53275e0ce1e0 service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-609f490e-baed-488f-9f10-3c1b496d6c4c req-e1bd3252-7d8c-42b0-bd65-53275e0ce1e0 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-609f490e-baed-488f-9f10-3c1b496d6c4c req-e1bd3252-7d8c-42b0-bd65-53275e0ce1e0 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-609f490e-baed-488f-9f10-3c1b496d6c4c req-e1bd3252-7d8c-42b0-bd65-53275e0ce1e0 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:06 user nova-compute[70914]: WARNING nova.compute.manager [req-609f490e-baed-488f-9f10-3c1b496d6c4c req-e1bd3252-7d8c-42b0-bd65-53275e0ce1e0 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state active and task_state rescuing.
Jul 27 13:37:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-d10f101f-4c50-4fb9-b83c-85be979d07b6 req-293325e0-55bf-4cca-820e-f2fda0bc4972 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d10f101f-4c50-4fb9-b83c-85be979d07b6 req-293325e0-55bf-4cca-820e-f2fda0bc4972 service nova] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d10f101f-4c50-4fb9-b83c-85be979d07b6 req-293325e0-55bf-4cca-820e-f2fda0bc4972 service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d10f101f-4c50-4fb9-b83c-85be979d07b6 req-293325e0-55bf-4cca-820e-f2fda0bc4972 service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-d10f101f-4c50-4fb9-b83c-85be979d07b6 req-293325e0-55bf-4cca-820e-f2fda0bc4972 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] No waiting events found dispatching network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:08 user nova-compute[70914]: WARNING nova.compute.manager [req-d10f101f-4c50-4fb9-b83c-85be979d07b6 req-293325e0-55bf-4cca-820e-f2fda0bc4972 service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received unexpected event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 13:37:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465029.0130768, 2f25226c-952e-482b-b2c1-77384b67bbed => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:37:09 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] VM Resumed (Lifecycle Event)
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:37:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Instance spawned successfully.
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-c97eff7a-0c05-4b4f-bce4-fedc5fb05992 req-aabd66f5-912a-4b9e-a081-d491f0e1d8f6 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c97eff7a-0c05-4b4f-bce4-fedc5fb05992 req-aabd66f5-912a-4b9e-a081-d491f0e1d8f6 service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c97eff7a-0c05-4b4f-bce4-fedc5fb05992 req-aabd66f5-912a-4b9e-a081-d491f0e1d8f6 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c97eff7a-0c05-4b4f-bce4-fedc5fb05992 req-aabd66f5-912a-4b9e-a081-d491f0e1d8f6 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-c97eff7a-0c05-4b4f-bce4-fedc5fb05992 req-aabd66f5-912a-4b9e-a081-d491f0e1d8f6 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:09 user nova-compute[70914]: WARNING nova.compute.manager [req-c97eff7a-0c05-4b4f-bce4-fedc5fb05992 req-aabd66f5-912a-4b9e-a081-d491f0e1d8f6 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state active and task_state rescuing.
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:09 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465029.0242836, 2f25226c-952e-482b-b2c1-77384b67bbed => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:37:09 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] VM Started (Lifecycle Event)
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d1c7a7ef-8fa2-4f39-b481-563506b37607 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:37:09 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for 1b676522-c547-497a-9b3b-8436f85c7f40 due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465029.1894984, 1b676522-c547-497a-9b3b-8436f85c7f40 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:37:09 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] VM Resumed (Lifecycle Event)
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70914) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 13:37:09 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465029.1917484, 1b676522-c547-497a-9b3b-8436f85c7f40 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:37:09 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] VM Started (Lifecycle Event)
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1398e87-9521-4ef1-be29-59e93f8271fe tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.141s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Acquiring lock "5a33a308-264e-445b-a47e-1b62773b4d6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Acquiring lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:12 user nova-compute[70914]: INFO nova.compute.manager [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Terminating instance
Jul 27 13:37:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:37:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-63db6bf8-9f6a-4f4f-b263-383a1a91236f req-3ef1c275-5bc7-468e-95d3-823b891a0c3d service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Received event network-vif-unplugged-38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63db6bf8-9f6a-4f4f-b263-383a1a91236f req-3ef1c275-5bc7-468e-95d3-823b891a0c3d service nova] Acquiring lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63db6bf8-9f6a-4f4f-b263-383a1a91236f req-3ef1c275-5bc7-468e-95d3-823b891a0c3d service nova] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63db6bf8-9f6a-4f4f-b263-383a1a91236f req-3ef1c275-5bc7-468e-95d3-823b891a0c3d service nova] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-63db6bf8-9f6a-4f4f-b263-383a1a91236f req-3ef1c275-5bc7-468e-95d3-823b891a0c3d service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] No waiting events found dispatching network-vif-unplugged-38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-63db6bf8-9f6a-4f4f-b263-383a1a91236f req-3ef1c275-5bc7-468e-95d3-823b891a0c3d service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Received event network-vif-unplugged-38b28ca6-c959-4b13-b364-c1f7765f993f for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Instance destroyed successfully.
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lazy-loading 'resources' on Instance uuid 5a33a308-264e-445b-a47e-1b62773b4d6d {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:35:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-643992360',display_name='tempest-VolumesNegativeTest-instance-643992360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-643992360',id=15,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:35:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33f2a357814f49dd97c2e49c42c67aba',ramdisk_id='',reservation_id='r-nncbyckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1627821327',owner_user_name='tempest-VolumesNegativeTest-1627821327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:35:31Z,user_data=None,user_id='ff78fd72dfc9498f8a6bde315cdf6902',uuid=5a33a308-264e-445b-a47e-1b62773b4d6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38b28ca6-c959-4b13-b364-c1f7765f993f", "address": "fa:16:3e:e0:7c:6a", "network": {"id": "309c252c-02e4-48ff-acf8-79e0e90531e2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e48802ad24da44e8b3554f42c9496c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b28ca6-c9", "ovs_interfaceid": "38b28ca6-c959-4b13-b364-c1f7765f993f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Converting VIF {"id": "38b28ca6-c959-4b13-b364-c1f7765f993f", "address": "fa:16:3e:e0:7c:6a", "network": {"id": "309c252c-02e4-48ff-acf8-79e0e90531e2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e48802ad24da44e8b3554f42c9496c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b28ca6-c9", "ovs_interfaceid": "38b28ca6-c959-4b13-b364-c1f7765f993f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:6a,bridge_name='br-int',has_traffic_filtering=True,id=38b28ca6-c959-4b13-b364-c1f7765f993f,network=Network(309c252c-02e4-48ff-acf8-79e0e90531e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b28ca6-c9') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG os_vif [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:6a,bridge_name='br-int',has_traffic_filtering=True,id=38b28ca6-c959-4b13-b364-c1f7765f993f,network=Network(309c252c-02e4-48ff-acf8-79e0e90531e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b28ca6-c9') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38b28ca6-c9, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:13 user nova-compute[70914]: INFO os_vif [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:6a,bridge_name='br-int',has_traffic_filtering=True,id=38b28ca6-c959-4b13-b364-c1f7765f993f,network=Network(309c252c-02e4-48ff-acf8-79e0e90531e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b28ca6-c9')
Jul 27 13:37:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Deleting instance files /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d_del
Jul 27 13:37:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Deletion of /opt/stack/data/nova/instances/5a33a308-264e-445b-a47e-1b62773b4d6d_del complete
Jul 27 13:37:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:37:13 user nova-compute[70914]: INFO nova.compute.manager [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Took 1.13 seconds to destroy the instance on the hypervisor.
Jul 27 13:37:13 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:13 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:37:13 user nova-compute[70914]: INFO nova.compute.claims [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Claim successful on node user
Jul 27 13:37:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:37:14 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-9eeaff7b-7516-4bfa-807f-110d2471314d req-cd02da9f-7f4c-4543-ab44-69f8c48e0244 service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Received event network-vif-deleted-38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:14 user nova-compute[70914]: INFO nova.compute.manager [req-9eeaff7b-7516-4bfa-807f-110d2471314d req-cd02da9f-7f4c-4543-ab44-69f8c48e0244 service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Neutron deleted interface 38b28ca6-c959-4b13-b364-c1f7765f993f; detaching it from the instance and deleting it from the info cache
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.network.neutron [req-9eeaff7b-7516-4bfa-807f-110d2471314d req-cd02da9f-7f4c-4543-ab44-69f8c48e0244 service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:37:14 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Took 1.03 seconds to deallocate network for instance.
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-9eeaff7b-7516-4bfa-807f-110d2471314d req-cd02da9f-7f4c-4543-ab44-69f8c48e0244 service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Detach interface failed, port_id=38b28ca6-c959-4b13-b364-c1f7765f993f, reason: Instance 5a33a308-264e-445b-a47e-1b62773b4d6d could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.policy [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '252ad07dbf034a09b3be3c05dba67b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da684ade5ad4a328eb543f6d6da0ad9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:37:14 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Creating image(s)
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "/opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "/opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "/opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.189s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.219s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk 1073741824" returned: 0 in 0.072s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG nova.compute.manager [req-5608eca7-73a6-45ef-9a26-d9137d27b2b7 req-edb82ed4-c16b-44e8-a5d6-a401636832a8 service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Received event network-vif-plugged-38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5608eca7-73a6-45ef-9a26-d9137d27b2b7 req-edb82ed4-c16b-44e8-a5d6-a401636832a8 service nova] Acquiring lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5608eca7-73a6-45ef-9a26-d9137d27b2b7 req-edb82ed4-c16b-44e8-a5d6-a401636832a8 service nova] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5608eca7-73a6-45ef-9a26-d9137d27b2b7 req-edb82ed4-c16b-44e8-a5d6-a401636832a8 service nova] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG nova.compute.manager [req-5608eca7-73a6-45ef-9a26-d9137d27b2b7 req-edb82ed4-c16b-44e8-a5d6-a401636832a8 service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] No waiting events found dispatching network-vif-plugged-38b28ca6-c959-4b13-b364-c1f7765f993f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:15 user nova-compute[70914]: WARNING nova.compute.manager [req-5608eca7-73a6-45ef-9a26-d9137d27b2b7 req-edb82ed4-c16b-44e8-a5d6-a401636832a8 service nova] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Received unexpected event network-vif-plugged-38b28ca6-c959-4b13-b364-c1f7765f993f for instance with vm_state deleted and task_state None.
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.212s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Checking if we can resize image /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Cannot resize image /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG nova.objects.instance [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'migration_context' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Ensure instance console log exists: /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.310s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:16 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Deleted allocations for instance 5a33a308-264e-445b-a47e-1b62773b4d6d
Jul 27 13:37:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3e60c5cf-0118-4cc3-98d8-2fcdfbebc060 tempest-VolumesNegativeTest-1627821327 tempest-VolumesNegativeTest-1627821327-project-member] Lock "5a33a308-264e-445b-a47e-1b62773b4d6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.969s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:16 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Successfully created port: 31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:37:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Successfully updated port: 31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:37:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:37:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquired lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:37:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:37:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-8dfb2e4f-f286-4ca4-9156-c44ba615d677 req-b3451341-2f6c-4535-9261-bb4e7d21183d service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-changed-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-8dfb2e4f-f286-4ca4-9156-c44ba615d677 req-b3451341-2f6c-4535-9261-bb4e7d21183d service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Refreshing instance network info cache due to event network-changed-31f7f5f5-e982-4083-a3dd-48fd7e526cd5. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:37:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8dfb2e4f-f286-4ca4-9156-c44ba615d677 req-b3451341-2f6c-4535-9261-bb4e7d21183d service nova] Acquiring lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:37:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updating instance_info_cache with network_info: [{"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Releasing lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Instance network_info: |[{"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8dfb2e4f-f286-4ca4-9156-c44ba615d677 req-b3451341-2f6c-4535-9261-bb4e7d21183d service nova] Acquired lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.network.neutron [req-8dfb2e4f-f286-4ca4-9156-c44ba615d677 req-b3451341-2f6c-4535-9261-bb4e7d21183d service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Refreshing network info cache for port 31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Start _get_guest_xml network_info=[{"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:37:18 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:37:18 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-930458355',display_name='tempest-ServerActionsTestOtherA-server-930458355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-930458355',id=17,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-82o8h0rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=814e062c-85d1-486b-8c7e-9198fbfc5f63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.objects.instance [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'pci_devices' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:18 user nova-compute[70914]: INFO nova.compute.manager [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Detaching volume 7e0db927-7ad2-463c-b9be-2b841e170cc7
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:37:18 user nova-compute[70914]:   <uuid>814e062c-85d1-486b-8c7e-9198fbfc5f63</uuid>
Jul 27 13:37:18 user nova-compute[70914]:   <name>instance-00000011</name>
Jul 27 13:37:18 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:37:18 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:37:18 user nova-compute[70914]:   <metadata>
Jul 27 13:37:18 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:37:18 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:37:18 user nova-compute[70914]:       <nova:name>tempest-ServerActionsTestOtherA-server-930458355</nova:name>
Jul 27 13:37:18 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:37:18</nova:creationTime>
Jul 27 13:37:18 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:37:18 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:37:18 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:37:18 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:37:18 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:37:18 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:37:18 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:37:18 user nova-compute[70914]:       <nova:owner>
Jul 27 13:37:18 user nova-compute[70914]:         <nova:user uuid="252ad07dbf034a09b3be3c05dba67b3f">tempest-ServerActionsTestOtherA-1561010505-project-member</nova:user>
Jul 27 13:37:18 user nova-compute[70914]:         <nova:project uuid="5da684ade5ad4a328eb543f6d6da0ad9">tempest-ServerActionsTestOtherA-1561010505</nova:project>
Jul 27 13:37:18 user nova-compute[70914]:       </nova:owner>
Jul 27 13:37:18 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:37:18 user nova-compute[70914]:       <nova:ports>
Jul 27 13:37:18 user nova-compute[70914]:         <nova:port uuid="31f7f5f5-e982-4083-a3dd-48fd7e526cd5">
Jul 27 13:37:18 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 13:37:18 user nova-compute[70914]:         </nova:port>
Jul 27 13:37:18 user nova-compute[70914]:       </nova:ports>
Jul 27 13:37:18 user nova-compute[70914]:     </nova:instance>
Jul 27 13:37:18 user nova-compute[70914]:   </metadata>
Jul 27 13:37:18 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:37:18 user nova-compute[70914]:     <system>
Jul 27 13:37:18 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:37:18 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:37:18 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:37:18 user nova-compute[70914]:       <entry name="serial">814e062c-85d1-486b-8c7e-9198fbfc5f63</entry>
Jul 27 13:37:18 user nova-compute[70914]:       <entry name="uuid">814e062c-85d1-486b-8c7e-9198fbfc5f63</entry>
Jul 27 13:37:18 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:37:18 user nova-compute[70914]:     </system>
Jul 27 13:37:18 user nova-compute[70914]:   </sysinfo>
Jul 27 13:37:18 user nova-compute[70914]:   <os>
Jul 27 13:37:18 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:37:18 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:37:18 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:37:18 user nova-compute[70914]:   </os>
Jul 27 13:37:18 user nova-compute[70914]:   <features>
Jul 27 13:37:18 user nova-compute[70914]:     <acpi/>
Jul 27 13:37:18 user nova-compute[70914]:     <apic/>
Jul 27 13:37:18 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:37:18 user nova-compute[70914]:   </features>
Jul 27 13:37:18 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:37:18 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:37:18 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:37:18 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:37:18 user nova-compute[70914]:   </clock>
Jul 27 13:37:18 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:37:18 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:37:18 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:37:18 user nova-compute[70914]:   </cpu>
Jul 27 13:37:18 user nova-compute[70914]:   <devices>
Jul 27 13:37:18 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:37:18 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:37:18 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk"/>
Jul 27 13:37:18 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:37:18 user nova-compute[70914]:     </disk>
Jul 27 13:37:18 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:37:18 user nova-compute[70914]:       <mac address="fa:16:3e:f6:64:4a"/>
Jul 27 13:37:18 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:37:18 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:37:18 user nova-compute[70914]:       <target dev="tap31f7f5f5-e9"/>
Jul 27 13:37:18 user nova-compute[70914]:     </interface>
Jul 27 13:37:18 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:37:18 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/console.log" append="off"/>
Jul 27 13:37:18 user nova-compute[70914]:     </serial>
Jul 27 13:37:18 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:37:18 user nova-compute[70914]:     <video>
Jul 27 13:37:18 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:37:18 user nova-compute[70914]:     </video>
Jul 27 13:37:18 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:37:18 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:37:18 user nova-compute[70914]:     </rng>
Jul 27 13:37:18 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:37:18 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:37:18 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:37:18 user nova-compute[70914]:     </memballoon>
Jul 27 13:37:18 user nova-compute[70914]:   </devices>
Jul 27 13:37:18 user nova-compute[70914]: </domain>
Jul 27 13:37:18 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-930458355',display_name='tempest-ServerActionsTestOtherA-server-930458355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-930458355',id=17,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-82o8h0rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=814e062c-85d1-486b-8c7e-9198fbfc5f63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG os_vif [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31f7f5f5-e9, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31f7f5f5-e9, col_values=(('external_ids', {'iface-id': '31f7f5f5-e982-4083-a3dd-48fd7e526cd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:64:4a', 'vm-uuid': '814e062c-85d1-486b-8c7e-9198fbfc5f63'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:18 user nova-compute[70914]: INFO os_vif [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9')
Jul 27 13:37:18 user nova-compute[70914]: INFO nova.virt.block_device [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attempting to driver detach volume 7e0db927-7ad2-463c-b9be-2b841e170cc7 from mountpoint /dev/vdb
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Attempting to detach device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:37:18 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:37:18 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:37:18 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:37:18 user nova-compute[70914]:   <serial>7e0db927-7ad2-463c-b9be-2b841e170cc7</serial>
Jul 27 13:37:18 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:37:18 user nova-compute[70914]: </disk>
Jul 27 13:37:18 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:37:18 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Successfully detached device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the persistent domain config.
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:37:18 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:37:18 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:37:18 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:37:18 user nova-compute[70914]:   <serial>7e0db927-7ad2-463c-b9be-2b841e170cc7</serial>
Jul 27 13:37:18 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:37:18 user nova-compute[70914]: </disk>
Jul 27 13:37:18 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No VIF found with MAC fa:16:3e:f6:64:4a, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:37:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG nova.network.neutron [req-8dfb2e4f-f286-4ca4-9156-c44ba615d677 req-b3451341-2f6c-4535-9261-bb4e7d21183d service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updated VIF entry in instance network info cache for port 31f7f5f5-e982-4083-a3dd-48fd7e526cd5. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG nova.network.neutron [req-8dfb2e4f-f286-4ca4-9156-c44ba615d677 req-b3451341-2f6c-4535-9261-bb4e7d21183d service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updating instance_info_cache with network_info: [{"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8dfb2e4f-f286-4ca4-9156-c44ba615d677 req-b3451341-2f6c-4535-9261-bb4e7d21183d service nova] Releasing lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465039.3993516, 72a9344d-135a-4283-b42e-cf0e5fb4bc75 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:37:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Successfully detached device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the live domain config.
Jul 27 13:37:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGNihWHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:37:19 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b9c9e3-3e4c-4eda-be59-4953b5719d67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:37:19 user nova-compute[70914]: No targets found.
Jul 27 13:37:19 user nova-compute[70914]: iSNS:
Jul 27 13:37:19 user nova-compute[70914]: No targets found.
Jul 27 13:37:19 user nova-compute[70914]: STATIC:
Jul 27 13:37:19 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:37:19 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:37:19 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:37:19 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7
Jul 27 13:37:19 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:37:19 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:37:19 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:37:19 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:37:19 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:37:19 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:37:19 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:37:19 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:37:19 user nova-compute[70914]: FIRMWARE:
Jul 27 13:37:19 user nova-compute[70914]: No targets found.
Jul 27 13:37:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:37:19 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:37:19 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf727584-46e7-480e-a30c-677913b35af9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b20d884-28fc-42cc-b3d7-cf31fd3beccf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:37:19 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:37:19 user nova-compute[70914]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)
Jul 27 13:37:19 user nova-compute[70914]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:37:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:37:19 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:37:19 user nova-compute[70914]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 (non-flash)
Jul 27 13:37:19 user nova-compute[70914]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:37:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c1855a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5b9a8e-07e1-4281-8213-24e9d5c320aa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f563478f-f5d6-4de3-bc05-83968d1c727d]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef595d6-b430-4114-9ed1-eebc2aa5209c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb32063-d9da-4cf9-b693-e3004dc9341a]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5543f624-845e-4afe-a48d-7a9c01a28fea]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb557528-2099-47b4-bded-457c4295d48c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7, portal: 172.16.0.220,3260]
Jul 27 13:37:19 user nova-compute[70914]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7, portal: 172.16.0.220,3260] successful.
Jul 27 13:37:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0db927-7ad2-463c-b9be-2b841e170cc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9414e020-d774-435a-bbb5-1f7317644c26]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== disconnect_volume: return (376ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:37:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:37:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:20 user nova-compute[70914]: DEBUG nova.objects.instance [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:37:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6496393f-c2b9-4fad-bc54-53029e592d50 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.245s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-5c54d1e3-1939-44f3-8a43-b3d28f27c4af req-4ce803fc-11e3-4d03-ac31-dcfebf5d48a6 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5c54d1e3-1939-44f3-8a43-b3d28f27c4af req-4ce803fc-11e3-4d03-ac31-dcfebf5d48a6 service nova] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5c54d1e3-1939-44f3-8a43-b3d28f27c4af req-4ce803fc-11e3-4d03-ac31-dcfebf5d48a6 service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5c54d1e3-1939-44f3-8a43-b3d28f27c4af req-4ce803fc-11e3-4d03-ac31-dcfebf5d48a6 service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-5c54d1e3-1939-44f3-8a43-b3d28f27c4af req-4ce803fc-11e3-4d03-ac31-dcfebf5d48a6 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] No waiting events found dispatching network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:20 user nova-compute[70914]: WARNING nova.compute.manager [req-5c54d1e3-1939-44f3-8a43-b3d28f27c4af req-4ce803fc-11e3-4d03-ac31-dcfebf5d48a6 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received unexpected event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 for instance with vm_state building and task_state spawning.
Jul 27 13:37:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465042.7610824, 814e062c-85d1-486b-8c7e-9198fbfc5f63 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:37:22 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] VM Resumed (Lifecycle Event)
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:37:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Instance spawned successfully.
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:37:22 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465042.7692595, 814e062c-85d1-486b-8c7e-9198fbfc5f63 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:37:22 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] VM Started (Lifecycle Event)
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:37:22 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:37:22 user nova-compute[70914]: INFO nova.compute.manager [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Took 8.24 seconds to spawn the instance on the hypervisor.
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-8927f64e-91fc-4a5d-a6ee-1795914534c8 req-453872ec-9163-40b8-b58c-e297b41e1de3 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8927f64e-91fc-4a5d-a6ee-1795914534c8 req-453872ec-9163-40b8-b58c-e297b41e1de3 service nova] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8927f64e-91fc-4a5d-a6ee-1795914534c8 req-453872ec-9163-40b8-b58c-e297b41e1de3 service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8927f64e-91fc-4a5d-a6ee-1795914534c8 req-453872ec-9163-40b8-b58c-e297b41e1de3 service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-8927f64e-91fc-4a5d-a6ee-1795914534c8 req-453872ec-9163-40b8-b58c-e297b41e1de3 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] No waiting events found dispatching network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:37:22 user nova-compute[70914]: WARNING nova.compute.manager [req-8927f64e-91fc-4a5d-a6ee-1795914534c8 req-453872ec-9163-40b8-b58c-e297b41e1de3 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received unexpected event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 for instance with vm_state building and task_state spawning.
Jul 27 13:37:23 user nova-compute[70914]: INFO nova.compute.manager [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Took 9.51 seconds to build instance.
Jul 27 13:37:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9e0bbd6e-b3e5-40e2-8d20-9d48e822794d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.644s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:28 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465033.2225757, 5a33a308-264e-445b-a47e-1b62773b4d6d => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:37:28 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] VM Stopped (Lifecycle Event)
Jul 27 13:37:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-6493f930-3cc5-47e7-b5fe-96f009bddffa None None] [instance: 5a33a308-264e-445b-a47e-1b62773b4d6d] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:37:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:30 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 13:37:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] There are 0 instances to clean {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 13:37:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:37:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances with incomplete migration  {{(pid=70914) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 13:37:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:36 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:37:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:37:40 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:37:40 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7078MB free_disk=25.66796875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Applying migration context for instance 38108984-8bd8-49b6-9111-33c084a5a16a as it has an incoming, in-progress migration 30e73217-e7e5-410a-acb8-cd55480be645. Migration status is finished {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 13:37:40 user nova-compute[70914]: INFO nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating resource usage from migration 30e73217-e7e5-410a-acb8-cd55480be645
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance d54b6163-cc14-44d4-91c6-d306168bb875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 2f25226c-952e-482b-b2c1-77384b67bbed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Migration 30e73217-e7e5-410a-acb8-cd55480be645 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 38108984-8bd8-49b6-9111-33c084a5a16a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 509e7547-8472-4954-8fc6-a152e9667437 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:37:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:37:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:41 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:37:41 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:37:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:37:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Updating instance_info_cache with network_info: [{"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-d54b6163-cc14-44d4-91c6-d306168bb875" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:37:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:37:58 user nova-compute[70914]: INFO nova.compute.claims [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Claim successful on node user
Jul 27 13:37:58 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Refreshing inventories for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Updating ProviderTree inventory for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Refreshing aggregate associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, aggregates: None {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Refreshing trait associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 13:37:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:37:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:37:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:37:59 user nova-compute[70914]: INFO nova.virt.block_device [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Booting with volume 84c12f28-90f2-4f30-a359-ba3a1632533c at /dev/vda
Jul 27 13:37:59 user nova-compute[70914]: DEBUG os_brick.utils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0d1239-176a-4811-8318-e7a1f6f3a857]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG nova.policy [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90d1b91444c44871908744b33bf33772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316542161a3c466cabddb6eadf93087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2620f77-676c-49a4-b5c3-45b5a4ea1c64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[502f1e6d-6cb2-48a2-9aba-eedb7986dd50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08c0d10-89a3-403e-a102-44114091a2f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:37:59 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[53584237-38df-4caf-bec9-539c445ad02d]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG os_brick.utils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating existing volume attachment record: f644e969-d309-41b5-952a-4a76e5d13ab8 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:37:59 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:37:59 user nova-compute[70914]: INFO nova.compute.claims [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Claim successful on node user
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully created port: 34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:38:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.policy [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93a3be9b082b4facadeff78db34d2519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61774ce82df2478186c9bbed654b8c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:38:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Creating image(s)
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "/opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "/opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "/opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully created port: cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk 1073741824" returned: 0 in 0.055s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.160s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Cannot resize image /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG nova.objects.instance [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lazy-loading 'migration_context' on Instance uuid 10fa8c48-a95a-411f-9de0-aabf19455f57 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Ensure instance console log exists: /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Successfully created port: 57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:38:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully created port: 07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Successfully updated port: 57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "refresh_cache-10fa8c48-a95a-411f-9de0-aabf19455f57" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquired lock "refresh_cache-10fa8c48-a95a-411f-9de0-aabf19455f57" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-d444a865-fcf1-4a54-93ef-51e9b2a7659a req-d25d7e84-2390-4917-924a-94ee08277542 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received event network-changed-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-d444a865-fcf1-4a54-93ef-51e9b2a7659a req-d25d7e84-2390-4917-924a-94ee08277542 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Refreshing instance network info cache due to event network-changed-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d444a865-fcf1-4a54-93ef-51e9b2a7659a req-d25d7e84-2390-4917-924a-94ee08277542 service nova] Acquiring lock "refresh_cache-10fa8c48-a95a-411f-9de0-aabf19455f57" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Updating instance_info_cache with network_info: [{"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Releasing lock "refresh_cache-10fa8c48-a95a-411f-9de0-aabf19455f57" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Instance network_info: |[{"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d444a865-fcf1-4a54-93ef-51e9b2a7659a req-d25d7e84-2390-4917-924a-94ee08277542 service nova] Acquired lock "refresh_cache-10fa8c48-a95a-411f-9de0-aabf19455f57" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.network.neutron [req-d444a865-fcf1-4a54-93ef-51e9b2a7659a req-d25d7e84-2390-4917-924a-94ee08277542 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Refreshing network info cache for port 57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Start _get_guest_xml network_info=[{"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:38:02 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:38:02 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1055498625',display_name='tempest-VolumesAdminNegativeTest-server-1055498625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1055498625',id=19,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9qiIdtEZBGn/VUXpZBhN6UDEO+Lo6dkWHTHqunhBQWTKSvweq1YMLNjZ02iz3PIK2eVM1q8vqTxGY3tN1jB8qWu7QZvhdu96H92E9vhq/5wpOyQK12kqKcJMW1LkSIzg==',key_name='tempest-keypair-1745123018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61774ce82df2478186c9bbed654b8c4d',ramdisk_id='',reservation_id='r-qi91vbbq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1597280425',owner_user_name='tempest-VolumesAdminNegativeTest-1597280425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:38:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a3be9b082b4facadeff78db34d2519',uuid=10fa8c48-a95a-411f-9de0-aabf19455f57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converting VIF {"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:3b,bridge_name='br-int',has_traffic_filtering=True,id=57228a08-7e4c-4c7b-bbcd-ada78b6ec66e,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57228a08-7e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.objects.instance [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lazy-loading 'pci_devices' on Instance uuid 10fa8c48-a95a-411f-9de0-aabf19455f57 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:38:02 user nova-compute[70914]:   <uuid>10fa8c48-a95a-411f-9de0-aabf19455f57</uuid>
Jul 27 13:38:02 user nova-compute[70914]:   <name>instance-00000013</name>
Jul 27 13:38:02 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:38:02 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:38:02 user nova-compute[70914]:   <metadata>
Jul 27 13:38:02 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:38:02 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:38:02 user nova-compute[70914]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1055498625</nova:name>
Jul 27 13:38:02 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:38:02</nova:creationTime>
Jul 27 13:38:02 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:38:02 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:38:02 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:38:02 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:38:02 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:38:02 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:38:02 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:38:02 user nova-compute[70914]:       <nova:owner>
Jul 27 13:38:02 user nova-compute[70914]:         <nova:user uuid="93a3be9b082b4facadeff78db34d2519">tempest-VolumesAdminNegativeTest-1597280425-project-member</nova:user>
Jul 27 13:38:02 user nova-compute[70914]:         <nova:project uuid="61774ce82df2478186c9bbed654b8c4d">tempest-VolumesAdminNegativeTest-1597280425</nova:project>
Jul 27 13:38:02 user nova-compute[70914]:       </nova:owner>
Jul 27 13:38:02 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:38:02 user nova-compute[70914]:       <nova:ports>
Jul 27 13:38:02 user nova-compute[70914]:         <nova:port uuid="57228a08-7e4c-4c7b-bbcd-ada78b6ec66e">
Jul 27 13:38:02 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 13:38:02 user nova-compute[70914]:         </nova:port>
Jul 27 13:38:02 user nova-compute[70914]:       </nova:ports>
Jul 27 13:38:02 user nova-compute[70914]:     </nova:instance>
Jul 27 13:38:02 user nova-compute[70914]:   </metadata>
Jul 27 13:38:02 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:38:02 user nova-compute[70914]:     <system>
Jul 27 13:38:02 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:38:02 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:38:02 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:38:02 user nova-compute[70914]:       <entry name="serial">10fa8c48-a95a-411f-9de0-aabf19455f57</entry>
Jul 27 13:38:02 user nova-compute[70914]:       <entry name="uuid">10fa8c48-a95a-411f-9de0-aabf19455f57</entry>
Jul 27 13:38:02 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:38:02 user nova-compute[70914]:     </system>
Jul 27 13:38:02 user nova-compute[70914]:   </sysinfo>
Jul 27 13:38:02 user nova-compute[70914]:   <os>
Jul 27 13:38:02 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:38:02 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:38:02 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:38:02 user nova-compute[70914]:   </os>
Jul 27 13:38:02 user nova-compute[70914]:   <features>
Jul 27 13:38:02 user nova-compute[70914]:     <acpi/>
Jul 27 13:38:02 user nova-compute[70914]:     <apic/>
Jul 27 13:38:02 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:38:02 user nova-compute[70914]:   </features>
Jul 27 13:38:02 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:38:02 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:38:02 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:38:02 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:38:02 user nova-compute[70914]:   </clock>
Jul 27 13:38:02 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:38:02 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:38:02 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:38:02 user nova-compute[70914]:   </cpu>
Jul 27 13:38:02 user nova-compute[70914]:   <devices>
Jul 27 13:38:02 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:38:02 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:38:02 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk"/>
Jul 27 13:38:02 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:38:02 user nova-compute[70914]:     </disk>
Jul 27 13:38:02 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:38:02 user nova-compute[70914]:       <mac address="fa:16:3e:76:1d:3b"/>
Jul 27 13:38:02 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:02 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:38:02 user nova-compute[70914]:       <target dev="tap57228a08-7e"/>
Jul 27 13:38:02 user nova-compute[70914]:     </interface>
Jul 27 13:38:02 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:38:02 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/console.log" append="off"/>
Jul 27 13:38:02 user nova-compute[70914]:     </serial>
Jul 27 13:38:02 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:38:02 user nova-compute[70914]:     <video>
Jul 27 13:38:02 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:02 user nova-compute[70914]:     </video>
Jul 27 13:38:02 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:38:02 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:38:02 user nova-compute[70914]:     </rng>
Jul 27 13:38:02 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:38:02 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:38:02 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:38:02 user nova-compute[70914]:     </memballoon>
Jul 27 13:38:02 user nova-compute[70914]:   </devices>
Jul 27 13:38:02 user nova-compute[70914]: </domain>
Jul 27 13:38:02 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1055498625',display_name='tempest-VolumesAdminNegativeTest-server-1055498625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1055498625',id=19,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9qiIdtEZBGn/VUXpZBhN6UDEO+Lo6dkWHTHqunhBQWTKSvweq1YMLNjZ02iz3PIK2eVM1q8vqTxGY3tN1jB8qWu7QZvhdu96H92E9vhq/5wpOyQK12kqKcJMW1LkSIzg==',key_name='tempest-keypair-1745123018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61774ce82df2478186c9bbed654b8c4d',ramdisk_id='',reservation_id='r-qi91vbbq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1597280425',owner_user_name='tempest-VolumesAdminNegativeTest-1597280425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:38:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a3be9b082b4facadeff78db34d2519',uuid=10fa8c48-a95a-411f-9de0-aabf19455f57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converting VIF {"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:3b,bridge_name='br-int',has_traffic_filtering=True,id=57228a08-7e4c-4c7b-bbcd-ada78b6ec66e,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57228a08-7e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG os_vif [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:3b,bridge_name='br-int',has_traffic_filtering=True,id=57228a08-7e4c-4c7b-bbcd-ada78b6ec66e,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57228a08-7e') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57228a08-7e, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap57228a08-7e, col_values=(('external_ids', {'iface-id': '57228a08-7e4c-4c7b-bbcd-ada78b6ec66e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:1d:3b', 'vm-uuid': '10fa8c48-a95a-411f-9de0-aabf19455f57'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:02 user nova-compute[70914]: INFO os_vif [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:3b,bridge_name='br-int',has_traffic_filtering=True,id=57228a08-7e4c-4c7b-bbcd-ada78b6ec66e,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57228a08-7e')
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:38:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] No VIF found with MAC fa:16:3e:76:1d:3b, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:38:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully created port: 3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:38:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-d444a865-fcf1-4a54-93ef-51e9b2a7659a req-d25d7e84-2390-4917-924a-94ee08277542 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Updated VIF entry in instance network info cache for port 57228a08-7e4c-4c7b-bbcd-ada78b6ec66e. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:38:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-d444a865-fcf1-4a54-93ef-51e9b2a7659a req-d25d7e84-2390-4917-924a-94ee08277542 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Updating instance_info_cache with network_info: [{"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d444a865-fcf1-4a54-93ef-51e9b2a7659a req-d25d7e84-2390-4917-924a-94ee08277542 service nova] Releasing lock "refresh_cache-10fa8c48-a95a-411f-9de0-aabf19455f57" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully created port: 34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:38:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully updated port: 34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-83eeeddd-e535-4a29-9724-0ee713240016 req-c68ab818-23f1-48ba-89fc-39dee35d251c service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received event network-vif-plugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-83eeeddd-e535-4a29-9724-0ee713240016 req-c68ab818-23f1-48ba-89fc-39dee35d251c service nova] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-83eeeddd-e535-4a29-9724-0ee713240016 req-c68ab818-23f1-48ba-89fc-39dee35d251c service nova] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-83eeeddd-e535-4a29-9724-0ee713240016 req-c68ab818-23f1-48ba-89fc-39dee35d251c service nova] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-83eeeddd-e535-4a29-9724-0ee713240016 req-c68ab818-23f1-48ba-89fc-39dee35d251c service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] No waiting events found dispatching network-vif-plugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:04 user nova-compute[70914]: WARNING nova.compute.manager [req-83eeeddd-e535-4a29-9724-0ee713240016 req-c68ab818-23f1-48ba-89fc-39dee35d251c service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received unexpected event network-vif-plugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e for instance with vm_state building and task_state spawning.
Jul 27 13:38:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-c30d5d5f-9267-49bd-a603-373dc4270083 req-864d6fc2-121a-4abc-aa84-e461c1af1111 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-changed-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-c30d5d5f-9267-49bd-a603-373dc4270083 req-864d6fc2-121a-4abc-aa84-e461c1af1111 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing instance network info cache due to event network-changed-34f538a9-8a9c-47a8-8aae-5a96279d31d5. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c30d5d5f-9267-49bd-a603-373dc4270083 req-864d6fc2-121a-4abc-aa84-e461c1af1111 service nova] Acquiring lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c30d5d5f-9267-49bd-a603-373dc4270083 req-864d6fc2-121a-4abc-aa84-e461c1af1111 service nova] Acquired lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG nova.network.neutron [req-c30d5d5f-9267-49bd-a603-373dc4270083 req-864d6fc2-121a-4abc-aa84-e461c1af1111 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing network info cache for port 34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG nova.network.neutron [req-c30d5d5f-9267-49bd-a603-373dc4270083 req-864d6fc2-121a-4abc-aa84-e461c1af1111 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG nova.network.neutron [req-c30d5d5f-9267-49bd-a603-373dc4270083 req-864d6fc2-121a-4abc-aa84-e461c1af1111 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c30d5d5f-9267-49bd-a603-373dc4270083 req-864d6fc2-121a-4abc-aa84-e461c1af1111 service nova] Releasing lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:05 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully updated port: 7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully updated port: 4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465086.6026554, 10fa8c48-a95a-411f-9de0-aabf19455f57 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] VM Resumed (Lifecycle Event)
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:38:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Instance spawned successfully.
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:38:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465086.6052542, 10fa8c48-a95a-411f-9de0-aabf19455f57 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] VM Started (Lifecycle Event)
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-be9f8fa1-db63-4350-957b-0097ceacd355 req-7a73ec92-b699-406e-b219-197ae4c26254 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received event network-vif-plugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be9f8fa1-db63-4350-957b-0097ceacd355 req-7a73ec92-b699-406e-b219-197ae4c26254 service nova] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be9f8fa1-db63-4350-957b-0097ceacd355 req-7a73ec92-b699-406e-b219-197ae4c26254 service nova] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be9f8fa1-db63-4350-957b-0097ceacd355 req-7a73ec92-b699-406e-b219-197ae4c26254 service nova] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-be9f8fa1-db63-4350-957b-0097ceacd355 req-7a73ec92-b699-406e-b219-197ae4c26254 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] No waiting events found dispatching network-vif-plugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:06 user nova-compute[70914]: WARNING nova.compute.manager [req-be9f8fa1-db63-4350-957b-0097ceacd355 req-7a73ec92-b699-406e-b219-197ae4c26254 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received unexpected event network-vif-plugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e for instance with vm_state building and task_state spawning.
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:38:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:38:06 user nova-compute[70914]: INFO nova.compute.manager [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Took 6.11 seconds to spawn the instance on the hypervisor.
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-changed-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing instance network info cache due to event network-changed-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] Acquiring lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] Acquired lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.network.neutron [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing network info cache for port 7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:38:06 user nova-compute[70914]: INFO nova.compute.manager [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Took 7.01 seconds to build instance.
Jul 27 13:38:06 user nova-compute[70914]: DEBUG nova.network.neutron [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:38:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1fb63983-3871-418b-b6e6-77fcb97efe7c tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.119s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG nova.network.neutron [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] Releasing lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-changed-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing instance network info cache due to event network-changed-4e8a50a8-25a0-46f7-b454-ca19f327b6b1. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] Acquiring lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] Acquired lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG nova.network.neutron [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing network info cache for port 4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG nova.network.neutron [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully updated port: cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG nova.network.neutron [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9f78f4b4-ebc6-4791-a085-b929665f5734 req-8a05c5a0-26b0-4a39-b211-02c6709a78d2 service nova] Releasing lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:07 user nova-compute[70914]: INFO nova.virt.block_device [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Booting with volume fdda580b-8b57-4531-99c1-282ed9b0465d at /dev/vdb
Jul 27 13:38:07 user nova-compute[70914]: DEBUG os_brick.utils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb2a088-3363-4843-81a5-dac6cf2fbc7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e83685-5c79-4b90-89a7-80921e8d5076]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbf7a6f-a99b-45ba-a2b3-43c6458e79d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0117d025-cbad-4c3f-b76d-4fbe6648f4d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:38:08 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:38:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[97224ddb-8848-4972-97f1-1ee7291799c7]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG os_brick.utils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating existing volume attachment record: 81918fbc-6dbb-4b63-be44-81147f7dd3f3 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully updated port: 07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-changed-cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing instance network info cache due to event network-changed-cf2cbb47-3c62-4067-aed5-e1f597744523. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] Acquiring lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] Acquired lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG nova.network.neutron [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing network info cache for port cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:38:08 user nova-compute[70914]: DEBUG nova.network.neutron [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully updated port: 3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG nova.network.neutron [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] Releasing lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-changed-07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing instance network info cache due to event network-changed-07a5fb68-24d1-40db-a367-696868645122. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] Acquiring lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] Acquired lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG nova.network.neutron [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing network info cache for port 07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG nova.network.neutron [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG nova.network.neutron [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-24054fc3-0e10-40a6-a1e7-ce1094fe259f req-032dda0f-e407-4fb7-9bc0-267df64898b7 service nova] Releasing lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:10 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Successfully updated port: 34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:38:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquired lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:10 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:38:10 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:38:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-changed-3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing instance network info cache due to event network-changed-3621c1af-c3c1-4fa9-b948-1c0930d2157a. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:38:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] Acquiring lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [{"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Releasing lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Instance network_info: |[{"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] Acquired lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing network info cache for port 3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updated VIF entry in instance network info cache for port 3621c1af-c3c1-4fa9-b948-1c0930d2157a. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [{"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] Releasing lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-changed-34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing instance network info cache due to event network-changed-34242348-5fb7-4cf9-9d10-069ccec48e42. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] Acquiring lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] Acquired lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:13 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing network info cache for port 34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:38:14 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updated VIF entry in instance network info cache for port 34242348-5fb7-4cf9-9d10-069ccec48e42. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:38:14 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [{"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4648ea5-1cbf-4308-8112-a554bbbd5dbe req-9d429c1b-a23f-4ad2-b419-34cd0b916237 service nova] Releasing lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:14 user nova-compute[70914]: DEBUG nova.objects.instance [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:15 user nova-compute[70914]: INFO nova.compute.manager [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attaching volume 806ae18e-971f-4197-b54f-6ceb00807c05 to /dev/vdb
Jul 27 13:38:15 user nova-compute[70914]: DEBUG os_brick.utils [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e36f70-694b-4ced-9d20-e024b8e5333a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c625976-b447-4721-9879-7cff074e11e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a91edfb-614f-4f39-816d-82b2c009dd87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df03e7d-0748-423a-85af-ab8d7a7e7a54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:38:15 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:38:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c11db8-df82-4acc-9552-051c8c6fdce4]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG os_brick.utils [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:15 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Updating existing volume attachment record: fe35bcb1-6d41-4501-937d-4858ad4d5cac {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:16 user nova-compute[70914]: INFO nova.virt.block_device [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Booting with volume 176decad-0adf-410c-830e-5bc4cc0ea19d at /dev/vdc
Jul 27 13:38:16 user nova-compute[70914]: DEBUG os_brick.utils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab66fae8-054d-47b3-962c-c230deb43932]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf27a7a2-67aa-49ab-94ba-f4a14c58126b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cadb2c-ab7c-4c6d-a70b-960b6902fcd4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d808bece-1b0f-461f-b15a-29869d316b17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:38:16 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:38:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f09c68a-17a9-4383-aa87-8d0c7b4a3fc0]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG os_brick.utils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:16 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating existing volume attachment record: 595d6227-bbb7-40d6-b8aa-ad50bb907252 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Port ae2390d8-702c-478a-8f63-ff3c36403dc3 binding to destination host user is already ACTIVE {{(pid=70914) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquired lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "2f25226c-952e-482b-b2c1-77384b67bbed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:17 user nova-compute[70914]: INFO nova.compute.manager [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Terminating instance
Jul 27 13:38:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-b6ba3e2d-121f-40cc-ac51-29a0ee0ae44a req-ed36f2a6-4918-496c-9269-276475b6bb0c service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-vif-unplugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b6ba3e2d-121f-40cc-ac51-29a0ee0ae44a req-ed36f2a6-4918-496c-9269-276475b6bb0c service nova] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b6ba3e2d-121f-40cc-ac51-29a0ee0ae44a req-ed36f2a6-4918-496c-9269-276475b6bb0c service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b6ba3e2d-121f-40cc-ac51-29a0ee0ae44a req-ed36f2a6-4918-496c-9269-276475b6bb0c service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-b6ba3e2d-121f-40cc-ac51-29a0ee0ae44a req-ed36f2a6-4918-496c-9269-276475b6bb0c service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] No waiting events found dispatching network-vif-unplugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-b6ba3e2d-121f-40cc-ac51-29a0ee0ae44a req-ed36f2a6-4918-496c-9269-276475b6bb0c service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-vif-unplugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating instance_info_cache with network_info: [{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Releasing lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Creating tmpfile /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/tmpggepagjr to verify with other compute node that the instance is on the same shared storage. {{(pid=70914) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:18 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Instance destroyed successfully.
Jul 27 13:38:18 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'resources' on Instance uuid 2f25226c-952e-482b-b2c1-77384b67bbed {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1222468261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2055353492',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OojAdixfznGFq1DFKNCIKxcrjX+E9vG3RnHr9K0gfako8L+aQbe5jQFEZ9xGSZx+L1z6hfai/IJzJVF4i0/HETmmSR8l0MTYoqWjUkVS3bqQMlxlDM9T3JIc6tBeVwg==',key_name='tempest-keypair-666687196',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4c94597dacc420abba408e3b60f4a40',ramdisk_id='',reservation_id='r-wlsu70h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1997290170',owner_user_name='tempest-ServerActionsV293TestJSON-1997290170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9279e1abc6946bc970fa3b2b2119c67',uuid=2f25226c-952e-482b-b2c1-77384b67bbed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converting VIF {"id": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "address": "fa:16:3e:c1:0d:fd", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2338c5-67", "ovs_interfaceid": "ae2338c5-670a-42f8-999b-8e9fdbb83378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_vif [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae2338c5-67, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:18 user nova-compute[70914]: INFO os_vif [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:0d:fd,bridge_name='br-int',has_traffic_filtering=True,id=ae2338c5-670a-42f8-999b-8e9fdbb83378,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2338c5-67')
Jul 27 13:38:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIPfQUrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:18 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf10a64-b2e9-416c-bb2d-22045fd36ebe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:38:18 user nova-compute[70914]: No targets found.
Jul 27 13:38:18 user nova-compute[70914]: iSNS:
Jul 27 13:38:18 user nova-compute[70914]: No targets found.
Jul 27 13:38:18 user nova-compute[70914]: STATIC:
Jul 27 13:38:18 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:38:18 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:38:18 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:38:18 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:38:18 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:38:18 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:38:18 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68
Jul 27 13:38:18 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:38:18 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:38:18 user nova-compute[70914]: FIRMWARE:
Jul 27 13:38:18 user nova-compute[70914]: No targets found.
Jul 27 13:38:18 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:38:18 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:38:18 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb126b2a-b82c-40c3-85fe-84404065e7f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0125f8db-284f-4a5c-b42a-71e0335d202d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:38:18 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:38:18 user nova-compute[70914]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:38:18 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:38:18 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:38:18 user nova-compute[70914]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 (non-flash)
Jul 27 13:38:18 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf875d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68'): ({'sde'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Removing single pathed devices sde {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c872786-2bf7-446b-9be6-a6abd0b29470]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.039s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7007ed-6fd9-461f-ad9c-341b786cd1d0]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Flushing IO for device /dev/sde {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[199b3c59-2d52-4e8b-835c-524b7b404d70]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.093s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0038c5a2-a60a-4c3f-a233-e1529dd2abaa]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4b8899bf-5057fb70173021da', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4b8899bf', '/dev/disk/by-id/scsi-23530353766623730') {{(pid=82182) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be5046-6f26-446d-b5a2-536de9ded064]: (4, None) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb5781d-472a-4a39-b1d9-117ec863451f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[554298ca-5a1e-4fbe-9ba7-fdbc3f9bbce4]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260]
Jul 27 13:38:18 user nova-compute[70914]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68, portal: 172.16.0.220,3260] successful.
Jul 27 13:38:18 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d782ed7b-88de-430e-af81-93eb97c7ec68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25ddd68-b7b1-4553-b188-605d90148656]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] <== disconnect_volume: return (480ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:38:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Deleting instance files /opt/stack/data/nova/instances/2f25226c-952e-482b-b2c1-77384b67bbed_del
Jul 27 13:38:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Deletion of /opt/stack/data/nova/instances/2f25226c-952e-482b-b2c1-77384b67bbed_del complete
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:19 user nova-compute[70914]: INFO nova.compute.manager [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Detaching volume 216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:38:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance destroyed successfully.
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.objects.instance [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'resources' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1925007786',display_name='tempest-ServerActionsTestOtherB-server-1925007786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1925007786',id=5,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHExeREDDPpeeto4dRdX/RKJZ83dPJH4sXgXTDLxmQ+8ZlOJR2MBG7t/gorV67US4l275/41OOOBwoDR8FgADW9jHIAHwwSPLUWO/b4tEzLREH2uqa5IWe2ftSKsaPh2Hw==',key_name='tempest-keypair-168588775',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a180220b142349188245dd88298da020',ramdisk_id='',reservation_id='r-so1tb3rb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-874236545',owner_user_name='tempest-ServerActionsTestOtherB-874236545-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:36:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe9d73d3e87c4ad4a1ff9afb4ee6a9b0',uuid=38108984-8bd8-49b6-9111-33c084a5a16a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converting VIF {"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_vif [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae2390d8-70, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:19 user nova-compute[70914]: INFO os_vif [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70')
Jul 27 13:38:19 user nova-compute[70914]: INFO nova.compute.manager [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Took 1.53 seconds to destroy the instance on the hypervisor.
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:19 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[833695b4-38d3-41a3-9f08-7f256018e5cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:38:19 user nova-compute[70914]: No targets found.
Jul 27 13:38:19 user nova-compute[70914]: iSNS:
Jul 27 13:38:19 user nova-compute[70914]: No targets found.
Jul 27 13:38:19 user nova-compute[70914]: STATIC:
Jul 27 13:38:19 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:38:19 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:38:19 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:38:19 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:38:19 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:38:19 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:38:19 user nova-compute[70914]: FIRMWARE:
Jul 27 13:38:19 user nova-compute[70914]: No targets found.
Jul 27 13:38:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:38:19 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:38:19 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: INFO nova.virt.block_device [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Attempting to driver detach volume 216beadf-a53f-4a8f-afbd-87ee5dea9fb4 from mountpoint /dev/vdb
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5c020c-3c98-437a-9ba9-e755c9194cf4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Attempting to detach device vdb from instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:38:19 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:38:19 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 13:38:19 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:38:19 user nova-compute[70914]:   <serial>216beadf-a53f-4a8f-afbd-87ee5dea9fb4</serial>
Jul 27 13:38:19 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 13:38:19 user nova-compute[70914]: </disk>
Jul 27 13:38:19 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4074aa-330f-40c5-97a0-df45756608a0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:38:19 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:38:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:38:19 user nova-compute[70914]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:38:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c381abc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98'): ({'sdd'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Removing single pathed devices sdd {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:38:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully detached device vdb from instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 from the persistent domain config.
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:38:19 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:38:19 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 13:38:19 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:38:19 user nova-compute[70914]:   <serial>216beadf-a53f-4a8f-afbd-87ee5dea9fb4</serial>
Jul 27 13:38:19 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 13:38:19 user nova-compute[70914]: </disk>
Jul 27 13:38:19 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6369651c-6ab2-4552-b1ee-1e89eff95ad6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54c876f-0966-42f7-8286-253d3acd032c]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Flushing IO for device /dev/sdd {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfaef36-bef7-452f-8d48-768970b16fd8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc413f6-d07e-4514-9fac-2867b5dac9ad]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd5d1bd-b527-4df6-a8a0-2798fdad6d87]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef073f3-b75e-49dd-938f-ee271e5e0aaf]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]
Jul 27 13:38:19 user nova-compute[70914]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.
Jul 27 13:38:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d40279f-3974-49f5-8af4-9ac801ca0f4e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] <== disconnect_volume: return (355ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465099.6742055, bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:38:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully detached device vdb from instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 from the live domain config.
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzyovJCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:19 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24619b1-61e4-43b3-9af2-a2dadd581398]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:38:19 user nova-compute[70914]: No targets found.
Jul 27 13:38:19 user nova-compute[70914]: iSNS:
Jul 27 13:38:19 user nova-compute[70914]: No targets found.
Jul 27 13:38:19 user nova-compute[70914]: STATIC:
Jul 27 13:38:19 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4
Jul 27 13:38:19 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:38:19 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:38:19 user nova-compute[70914]: FIRMWARE:
Jul 27 13:38:19 user nova-compute[70914]: No targets found.
Jul 27 13:38:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:38:19 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:38:19 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d32258-cbb8-4294-b86d-328ca6b8cb84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b817d47f-f093-4ab1-8150-86e08e5e519e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:38:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 (non-flash)
Jul 27 13:38:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf87efbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4'): ({'sdc'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Removing single pathed devices sdc {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa385672-95f4-46b4-af1c-4885e09f51d2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[54563391-87c4-4d01-be24-c05516f16510]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flushing IO for device /dev/sdc {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a049d487-9ef8-4ff1-a2b6-f4cdae5647a0]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4037f330-7f5d-4e64-8472-3eb0e0cd8deb]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09b6a69-61a6-4194-bee9-63a2f0cc80c4]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] Acquiring lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] Lock "2f25226c-952e-482b-b2c1-77384b67bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] No waiting events found dispatching network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:19 user nova-compute[70914]: WARNING nova.compute.manager [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received unexpected event network-vif-plugged-ae2338c5-670a-42f8-999b-8e9fdbb83378 for instance with vm_state active and task_state deleting.
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:19 user nova-compute[70914]: WARNING nova.compute.manager [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state resized and task_state resize_reverting.
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:19 user nova-compute[70914]: WARNING nova.compute.manager [req-d50ec602-b942-4f6c-ad6c-acf906f2a567 req-2ae0d063-026e-48ce-bd13-3252e7957dda service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state resized and task_state resize_reverting.
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b96c9dc-ba2e-4482-a601-a805fecbdb51]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260]
Jul 27 13:38:19 user nova-compute[70914]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4, portal: 172.16.0.220,3260] successful.
Jul 27 13:38:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216beadf-a53f-4a8f-afbd-87ee5dea9fb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e56bd99-c898-4f72-98d2-d1589f22758a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== disconnect_volume: return (341ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:20 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Took 1.01 seconds to deallocate network for instance.
Jul 27 13:38:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-fb23454b-31d4-4d9d-ae4d-bbdf6c02e83c req-17051820-070f-443d-9a4a-852b67b69bcc service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Received event network-vif-deleted-ae2338c5-670a-42f8-999b-8e9fdbb83378 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:20 user nova-compute[70914]: INFO nova.compute.manager [req-fb23454b-31d4-4d9d-ae4d-bbdf6c02e83c req-17051820-070f-443d-9a4a-852b67b69bcc service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Neutron deleted interface ae2338c5-670a-42f8-999b-8e9fdbb83378; detaching it from the instance and deleting it from the info cache
Jul 27 13:38:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-fb23454b-31d4-4d9d-ae4d-bbdf6c02e83c req-17051820-070f-443d-9a4a-852b67b69bcc service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-fb23454b-31d4-4d9d-ae4d-bbdf6c02e83c req-17051820-070f-443d-9a4a-852b67b69bcc service nova] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Detach interface failed, port_id=ae2338c5-670a-42f8-999b-8e9fdbb83378, reason: Instance 2f25226c-952e-482b-b2c1-77384b67bbed could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:20 user nova-compute[70914]: DEBUG nova.objects.instance [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'migration_context' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG nova.objects.instance [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.927s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e8bbdbfe-01d3-4854-9132-e0c4e94d7af3 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.400s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bcdac099-4d91-4c64-8f90-09f32a26a813 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bcdac099-4d91-4c64-8f90-09f32a26a813 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bcdac099-4d91-4c64-8f90-09f32a26a813 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bcdac099-4d91-4c64-8f90-09f32a26a813 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70914) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG nova.objects.instance [None req-bcdac099-4d91-4c64-8f90-09f32a26a813 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:21 user nova-compute[70914]: INFO nova.compute.manager [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Swapping old allocation on dict_keys(['28f9fcbc-7a25-483f-af71-8564174ecae0']) held by migration 30e73217-e7e5-410a-acb8-cd55480be645 for instance
Jul 27 13:38:21 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Overwriting current allocation {'allocations': {'28f9fcbc-7a25-483f-af71-8564174ecae0': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 23}}, 'project_id': 'a180220b142349188245dd88298da020', 'user_id': 'fe9d73d3e87c4ad4a1ff9afb4ee6a9b0', 'consumer_generation': 1} on consumer 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-cad72953-8d83-4685-a0c0-839616a0619e req-afb07828-693c-4d35-807d-3df038cc1d04 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-unplugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cad72953-8d83-4685-a0c0-839616a0619e req-afb07828-693c-4d35-807d-3df038cc1d04 service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cad72953-8d83-4685-a0c0-839616a0619e req-afb07828-693c-4d35-807d-3df038cc1d04 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cad72953-8d83-4685-a0c0-839616a0619e req-afb07828-693c-4d35-807d-3df038cc1d04 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-cad72953-8d83-4685-a0c0-839616a0619e req-afb07828-693c-4d35-807d-3df038cc1d04 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-unplugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:22 user nova-compute[70914]: WARNING nova.compute.manager [req-cad72953-8d83-4685-a0c0-839616a0619e req-afb07828-693c-4d35-807d-3df038cc1d04 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-unplugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state active and task_state powering-off.
Jul 27 13:38:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquired lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG nova.network.neutron [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:38:22 user nova-compute[70914]: INFO nova.compute.manager [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Took 2.29 seconds to detach 1 volumes for instance.
Jul 27 13:38:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Deleting volume: d782ed7b-88de-430e-af81-93eb97c7ec68 {{(pid=70914) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-6dcb47f2-59e4-435d-b7e3-eb66e5748bca req-20dc7f85-6d7f-4879-bc03-a883c543b0c0 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-changed-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-6dcb47f2-59e4-435d-b7e3-eb66e5748bca req-20dc7f85-6d7f-4879-bc03-a883c543b0c0 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Refreshing instance network info cache due to event network-changed-7c115254-d063-49fe-b94c-e7a22b8ccb31. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6dcb47f2-59e4-435d-b7e3-eb66e5748bca req-20dc7f85-6d7f-4879-bc03-a883c543b0c0 service nova] Acquiring lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6dcb47f2-59e4-435d-b7e3-eb66e5748bca req-20dc7f85-6d7f-4879-bc03-a883c543b0c0 service nova] Acquired lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG nova.network.neutron [req-6dcb47f2-59e4-435d-b7e3-eb66e5748bca req-20dc7f85-6d7f-4879-bc03-a883c543b0c0 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Refreshing network info cache for port 7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:38:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance destroyed successfully.
Jul 27 13:38:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bcdac099-4d91-4c64-8f90-09f32a26a813 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:22 user nova-compute[70914]: INFO nova.compute.manager [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] instance snapshotting
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bcdac099-4d91-4c64-8f90-09f32a26a813 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.970s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Beginning live snapshot process
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json -f qcow2 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG nova.network.neutron [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating instance_info_cache with network_info: [{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Releasing lock "refresh_cache-38108984-8bd8-49b6-9111-33c084a5a16a" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG os_brick.utils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json -f qcow2 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fe54f5-cf3c-48da-8aef-25166f267bb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddc345f-9b1f-4af5-b418-3d665ba40527]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e158d05-a9c4-4e3e-a52a-59cec55127d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[995eae32-c1f0-4858-ac8c-bf9dd31ba60b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG nova.network.neutron [req-6dcb47f2-59e4-435d-b7e3-eb66e5748bca req-20dc7f85-6d7f-4879-bc03-a883c543b0c0 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updated VIF entry in instance network info cache for port 7c115254-d063-49fe-b94c-e7a22b8ccb31. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG nova.network.neutron [req-6dcb47f2-59e4-435d-b7e3-eb66e5748bca req-20dc7f85-6d7f-4879-bc03-a883c543b0c0 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating instance_info_cache with network_info: [{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:38:23 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2c0287-5e55-4e90-902d-1a8eed013dae]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.utils [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] <== get_connector_properties: return (248ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6dcb47f2-59e4-435d-b7e3-eb66e5748bca req-20dc7f85-6d7f-4879-bc03-a883c543b0c0 service nova] Releasing lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.706s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptvvocvgl/815eff46d53f4161b42a2ab08bb6b080.delta 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Deleted allocations for instance 2f25226c-952e-482b-b2c1-77384b67bbed
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptvvocvgl/815eff46d53f4161b42a2ab08bb6b080.delta 1073741824" returned: 0 in 0.051s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d59a75c0-bd15-4d97-96c3-73d190329847 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "2f25226c-952e-482b-b2c1-77384b67bbed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.905s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMipJyTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:23 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:23 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:23 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[93be3818-8f8b-4b9d-a0ed-fc8f6c11034e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:38:23 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adf1bb5-d70b-4bf3-b0fe-d11a6ea19395]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05] added
Jul 27 13:38:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb19f900-459b-4bdb-a152-aabb5c37f489]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fe0ac9-dd89-4528-a1c6-70aa64cfcc6e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HMipJyTK {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HMipJyTK" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5871b404-1b31-4790-a15a-d1aad9126c8c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HMipJyTK'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89c78cd-4893-4c9d-93e0-e3fcc8751ff7]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b5e89c-27e0-44c9-92fa-a74b6d18ef39]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 13:38:23 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 13:38:23 user nova-compute[70914]:  {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:23 user nova-compute[70914]: WARNING os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 13:38:23 user nova-compute[70914]: 
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1df1a4-846b-4326-bb60-5d3e20e60abf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05, portal: 172.16.0.220,3260]
Jul 27 13:38:23 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05, portal: 172.16.0.220,3260] successful.
Jul 27 13:38:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a6461b-adf4-4112-a9d2-7b401f29d7ce]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bc382e-bb34-4713-99d7-c7421286ebde]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b33a87b-3638-411c-ba65-f8ace45dce57]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-f5dcf64c-8d54-4712-aed5-7c57bb173822 req-eac8284f-5c01-474a-8791-323781eccacf service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f5dcf64c-8d54-4712-aed5-7c57bb173822 req-eac8284f-5c01-474a-8791-323781eccacf service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f5dcf64c-8d54-4712-aed5-7c57bb173822 req-eac8284f-5c01-474a-8791-323781eccacf service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f5dcf64c-8d54-4712-aed5-7c57bb173822 req-eac8284f-5c01-474a-8791-323781eccacf service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-f5dcf64c-8d54-4712-aed5-7c57bb173822 req-eac8284f-5c01-474a-8791-323781eccacf service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:24 user nova-compute[70914]: WARNING nova.compute.manager [req-f5dcf64c-8d54-4712-aed5-7c57bb173822 req-eac8284f-5c01-474a-8791-323781eccacf service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state stopped and task_state None.
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:38:24 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:38:24 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Creating image(s)
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Ensure instance console log exists: /opt/stack/data/nova/instances/5282ea2a-f5f3-423e-980c-d80a8b7405fd/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Start _get_guest_xml network_info=[{"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'f644e969-d309-41b5-952a-4a76e5d13ab8', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKRSWDQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5282ea2a-f5f3-423e-980c-d80a8b7405fd', 'attached_at': '', 'detached_at': '', 'volume_id': '84c12f28-90f2-4f30-a359-ba3a1632533c', 'serial': '84c12f28-90f2-4f30-a359-ba3a1632533c'}, 'mount_device': '/dev/vda', 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '81918fbc-6dbb-4b63-be44-81147f7dd3f3', 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WFVNYJbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5282ea2a-f5f3-423e-980c-d80a8b7405fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'fdda580b-8b57-4531-99c1-282ed9b0465d', 'serial': 'fdda580b-8b57-4531-99c1-282ed9b0465d'}, 'mount_device': '/dev/vdb', 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '595d6227-bbb7-40d6-b8aa-ad50bb907252', 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJynkfbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5282ea2a-f5f3-423e-980c-d80a8b7405fd', 'attached_at': '', 'detached_at': '', 'volume_id': '176decad-0adf-410c-830e-5bc4cc0ea19d', 'serial': '176decad-0adf-410c-830e-5bc4cc0ea19d'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:38:24 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:38:24 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKRSWDQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:24 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptvvocvgl/815eff46d53f4161b42a2ab08bb6b080.delta /opt/stack/data/nova/instances/snapshots/tmptvvocvgl/815eff46d53f4161b42a2ab08bb6b080 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMipJyTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23435313630363635', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435313630363635', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.047s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:24 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:24 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.objects.instance [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260" returned: 21 in 0.045s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a8c20f-98b8-43f9-88bc-bc4023efa47c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:38:24 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:38:24 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:38:24 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:38:24 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:38:24 user nova-compute[70914]:   <serial>806ae18e-971f-4197-b54f-6ceb00807c05</serial>
Jul 27 13:38:24 user nova-compute[70914]: </disk>
Jul 27 13:38:24 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2be2464-a8a0-4208-a389-093baafe6f1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c] added
Jul 27 13:38:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ac453f-d415-4bbb-b2b0-d5c270ccf3a0]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.046s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a81f53-ab1b-493f-8993-55437365f584]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKRSWDQr {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKRSWDQr" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcef5ed0-d45b-4c4e-a64b-1415018c5284]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AKRSWDQr'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[346d0ea2-552f-4d9c-b5a6-d7eced05bd03]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdfeea2-f816-4089-8305-7bc827535865]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cca0f5-b8c0-4eb6-84d6-f618584d6dd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c, portal: 172.16.0.220,3260]
Jul 27 13:38:25 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c, portal: 172.16.0.220,3260] successful.
Jul 27 13:38:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[648b0bfe-944f-43a9-afab-92bf5ff8b00f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[690deea6-9ae8-4d86-a74d-b8897b3dde05]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:25 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:25 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.074s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7401a4ff-3991-430e-86ec-52e29e5c317a]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No VIF found with MAC fa:16:3e:a7:1a:64, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptvvocvgl/815eff46d53f4161b42a2ab08bb6b080.delta /opt/stack/data/nova/instances/snapshots/tmptvvocvgl/815eff46d53f4161b42a2ab08bb6b080" returned: 0 in 0.732s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:25 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Snapshot extracted, beginning image upload
Jul 27 13:38:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-ea7ce753-5168-474a-abc2-b95d5f01b4fb tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.522s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKRSWDQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '23334333938646365', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334333938646365', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WFVNYJbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:26 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:26 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:26 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10ea575-db04-4498-bef2-b04b7d10b8fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:38:26 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a7163f-8d00-4d51-b18e-1de4bc0febfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d] added
Jul 27 13:38:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cae7a0-13ed-4c9b-8816-858785df4c65]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4dab4b-1c34-4676-b258-5215c3e90905]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WFVNYJbn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WFVNYJbn" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb60c381-b485-488e-9d45-46db31ed3e35]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WFVNYJbn'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca493e9-713f-4002-af91-725f7cbf2c66]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cfcea0-7d25-442e-99a1-ea913dbe07a0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:26 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:26 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1afd78-2e1e-4f4c-a5b4-19a84c90d1bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d, portal: 172.16.0.220,3260]
Jul 27 13:38:26 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d, portal: 172.16.0.220,3260] successful.
Jul 27 13:38:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[00467988-2def-4eae-b9fe-36b9240850c5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cef8434-f304-4259-b4c2-1b355267481b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:26 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:26 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:26 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:26 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d105b75-e814-43f3-b29b-3b95b55f8a82]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:38:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WFVNYJbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:27 user nova-compute[70914]: INFO nova.compute.manager [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Detaching volume 806ae18e-971f-4197-b54f-6ceb00807c05
Jul 27 13:38:27 user nova-compute[70914]: INFO nova.virt.block_device [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attempting to driver detach volume 806ae18e-971f-4197-b54f-6ceb00807c05 from mountpoint /dev/vdb
Jul 27 13:38:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Attempting to detach device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:38:27 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:38:27 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:38:27 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:38:27 user nova-compute[70914]:   <serial>806ae18e-971f-4197-b54f-6ceb00807c05</serial>
Jul 27 13:38:27 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:38:27 user nova-compute[70914]: </disk>
Jul 27 13:38:27 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:38:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Successfully detached device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the persistent domain config.
Jul 27 13:38:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:38:27 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:38:27 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:38:27 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:38:27 user nova-compute[70914]:   <serial>806ae18e-971f-4197-b54f-6ceb00807c05</serial>
Jul 27 13:38:27 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:38:27 user nova-compute[70914]: </disk>
Jul 27 13:38:27 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26362653165613566', 'path': '/dev/sdd'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362653165613566', 'path': '/dev/sdd'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJynkfbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:27 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:27 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:27 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d482b4d-3fa1-411b-90a5-de738e4c7f28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:38:27 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad72e4d5-d8d3-4bb4-95c8-f962f623c8ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d] added
Jul 27 13:38:27 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[43125bfd-7cf1-4af2-8eac-f355fa751de9]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0201de28-a0c0-4dc6-aa6b-87fd77f00bec]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oJynkfbI {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oJynkfbI" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a5855e-e83b-4862-99f9-720a140b37b8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oJynkfbI'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aa962a-64da-472b-9c25-b0a6ab437fd8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[149114e2-e023-428e-890d-f67455945196]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:27 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:27 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:27 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:27 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:27 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:27 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:27 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_power_states {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465108.0327165, 72a9344d-135a-4283-b42e-cf0e5fb4bc75 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:38:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Successfully detached device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the live domain config.
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b7cee4-9426-46a3-bc43-e5f7000c780a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d, portal: 172.16.0.220,3260]
Jul 27 13:38:28 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d, portal: 172.16.0.220,3260] successful.
Jul 27 13:38:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:28 user nova-compute[70914]: WARNING nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid e45fbfcb-0107-4410-b5e1-71ba56995748 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid d54b6163-cc14-44d4-91c6-d306168bb875 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 5282ea2a-f5f3-423e-980c-d80a8b7405fd {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 10fa8c48-a95a-411f-9de0-aabf19455f57 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "1b676522-c547-497a-9b3b-8436f85c7f40" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "38108984-8bd8-49b6-9111-33c084a5a16a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:28 user nova-compute[70914]: INFO nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "38108984-8bd8-49b6-9111-33c084a5a16a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "d54b6163-cc14-44d4-91c6-d306168bb875" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "d54b6163-cc14-44d4-91c6-d306168bb875" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "509e7547-8472-4954-8fc6-a152e9667437" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:28 user nova-compute[70914]: INFO nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] During sync_power_state the instance has a pending task (image_uploading). Skip.
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "509e7547-8472-4954-8fc6-a152e9667437" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMipJyTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:28 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9f149-7a76-4e8f-b798-c1fcb495795f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd88a06-ad82-45c1-8b6f-9d7381b2c23b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:28 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:28 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:28 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:38:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:28 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:28 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:28 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:38:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[befdfa3c-708b-478b-801a-71c069c650d6]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJynkfbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:38:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Snapshot image upload complete
Jul 27 13:38:28 user nova-compute[70914]: INFO nova.compute.manager [None req-b3de3762-54be-40c2-bdea-e0c5345cd730 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Took 5.66 seconds to snapshot the instance on the hypervisor.
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "1b676522-c547-497a-9b3b-8436f85c7f40" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "d54b6163-cc14-44d4-91c6-d306168bb875" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26162646635366666', 'path': '/dev/sde'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162646635366666', 'path': '/dev/sde'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.083s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:aa:13,bridge_name='br-int',has_traffic_filtering=True,id=34f538a9-8a9c-47a8-8aae-5a96279d31d5,network=Network(07f3571f-9eb1-405a-b8f2-ad5713e12021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f538a9-8a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d7:bc,bridge_name='br-int',has_traffic_filtering=True,id=7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6d11f3-e8') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=4e8a50a8-25a0-46f7-b454-ca19f327b6b1,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e8a50a8-25') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:bf:b4,bridge_name='br-int',has_traffic_filtering=True,id=cf2cbb47-3c62-4067-aed5-e1f597744523,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2cbb47-3c') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:80:45,bridge_name='br-int',has_traffic_filtering=True,id=07a5fb68-24d1-40db-a367-696868645122,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a5fb68-24') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:aa,bridge_name='br-int',has_traffic_filtering=True,id=3621c1af-c3c1-4fa9-b948-1c0930d2157a,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3621c1af-c3') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:46:a1,bridge_name='br-int',has_traffic_filtering=True,id=34242348-5fb7-4cf9-9d10-069ccec48e42,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34242348-5f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.objects.instance [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lazy-loading 'pci_devices' on Instance uuid 5282ea2a-f5f3-423e-980c-d80a8b7405fd {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eab08c7-0833-4030-90b3-835b91fdb862]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:38:29 user nova-compute[70914]: No targets found.
Jul 27 13:38:29 user nova-compute[70914]: iSNS:
Jul 27 13:38:29 user nova-compute[70914]: No targets found.
Jul 27 13:38:29 user nova-compute[70914]: STATIC:
Jul 27 13:38:29 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c
Jul 27 13:38:29 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:38:29 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:38:29 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05
Jul 27 13:38:29 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:38:29 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:38:29 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d
Jul 27 13:38:29 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:38:29 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:38:29 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d
Jul 27 13:38:29 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:38:29 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:38:29 user nova-compute[70914]: FIRMWARE:
Jul 27 13:38:29 user nova-compute[70914]: No targets found.
Jul 27 13:38:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:38:29 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:38:29 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:38:29 user nova-compute[70914]:   <uuid>5282ea2a-f5f3-423e-980c-d80a8b7405fd</uuid>
Jul 27 13:38:29 user nova-compute[70914]:   <name>instance-00000012</name>
Jul 27 13:38:29 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:38:29 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:38:29 user nova-compute[70914]:   <metadata>
Jul 27 13:38:29 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:38:29 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:38:29 user nova-compute[70914]:       <nova:name>tempest-device-tagging-server-1605254584</nova:name>
Jul 27 13:38:29 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:38:24</nova:creationTime>
Jul 27 13:38:29 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:38:29 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:38:29 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:38:29 user nova-compute[70914]:       <nova:owner>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:user uuid="90d1b91444c44871908744b33bf33772">tempest-TaggedBootDevicesTest-1250659975-project-member</nova:user>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:project uuid="316542161a3c466cabddb6eadf93087c">tempest-TaggedBootDevicesTest-1250659975</nova:project>
Jul 27 13:38:29 user nova-compute[70914]:       </nova:owner>
Jul 27 13:38:29 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:38:29 user nova-compute[70914]:       <nova:ports>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:port uuid="34f538a9-8a9c-47a8-8aae-5a96279d31d5">
Jul 27 13:38:29 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 13:38:29 user nova-compute[70914]:         </nova:port>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:port uuid="7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4">
Jul 27 13:38:29 user nova-compute[70914]:           <nova:ip type="fixed" address="10.1.1.70" ipVersion="4"/>
Jul 27 13:38:29 user nova-compute[70914]:         </nova:port>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:port uuid="4e8a50a8-25a0-46f7-b454-ca19f327b6b1">
Jul 27 13:38:29 user nova-compute[70914]:           <nova:ip type="fixed" address="10.1.1.138" ipVersion="4"/>
Jul 27 13:38:29 user nova-compute[70914]:         </nova:port>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:port uuid="cf2cbb47-3c62-4067-aed5-e1f597744523">
Jul 27 13:38:29 user nova-compute[70914]:           <nova:ip type="fixed" address="10.1.1.143" ipVersion="4"/>
Jul 27 13:38:29 user nova-compute[70914]:         </nova:port>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:port uuid="07a5fb68-24d1-40db-a367-696868645122">
Jul 27 13:38:29 user nova-compute[70914]:           <nova:ip type="fixed" address="10.1.1.198" ipVersion="4"/>
Jul 27 13:38:29 user nova-compute[70914]:         </nova:port>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:port uuid="3621c1af-c3c1-4fa9-b948-1c0930d2157a">
Jul 27 13:38:29 user nova-compute[70914]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 27 13:38:29 user nova-compute[70914]:         </nova:port>
Jul 27 13:38:29 user nova-compute[70914]:         <nova:port uuid="34242348-5fb7-4cf9-9d10-069ccec48e42">
Jul 27 13:38:29 user nova-compute[70914]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 27 13:38:29 user nova-compute[70914]:         </nova:port>
Jul 27 13:38:29 user nova-compute[70914]:       </nova:ports>
Jul 27 13:38:29 user nova-compute[70914]:     </nova:instance>
Jul 27 13:38:29 user nova-compute[70914]:   </metadata>
Jul 27 13:38:29 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:38:29 user nova-compute[70914]:     <system>
Jul 27 13:38:29 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:38:29 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:38:29 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:38:29 user nova-compute[70914]:       <entry name="serial">5282ea2a-f5f3-423e-980c-d80a8b7405fd</entry>
Jul 27 13:38:29 user nova-compute[70914]:       <entry name="uuid">5282ea2a-f5f3-423e-980c-d80a8b7405fd</entry>
Jul 27 13:38:29 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:38:29 user nova-compute[70914]:     </system>
Jul 27 13:38:29 user nova-compute[70914]:   </sysinfo>
Jul 27 13:38:29 user nova-compute[70914]:   <os>
Jul 27 13:38:29 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:38:29 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:38:29 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:38:29 user nova-compute[70914]:   </os>
Jul 27 13:38:29 user nova-compute[70914]:   <features>
Jul 27 13:38:29 user nova-compute[70914]:     <acpi/>
Jul 27 13:38:29 user nova-compute[70914]:     <apic/>
Jul 27 13:38:29 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:38:29 user nova-compute[70914]:   </features>
Jul 27 13:38:29 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:38:29 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:38:29 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:38:29 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:38:29 user nova-compute[70914]:   </clock>
Jul 27 13:38:29 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:38:29 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:38:29 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:38:29 user nova-compute[70914]:   </cpu>
Jul 27 13:38:29 user nova-compute[70914]:   <devices>
Jul 27 13:38:29 user nova-compute[70914]:     <disk type="file" device="cdrom">
Jul 27 13:38:29 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 13:38:29 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/5282ea2a-f5f3-423e-980c-d80a8b7405fd/disk.config"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="hda" bus="ide"/>
Jul 27 13:38:29 user nova-compute[70914]:     </disk>
Jul 27 13:38:29 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:38:29 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:38:29 user nova-compute[70914]:       <source dev="/dev/sdc"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:       <serial>84c12f28-90f2-4f30-a359-ba3a1632533c</serial>
Jul 27 13:38:29 user nova-compute[70914]:     </disk>
Jul 27 13:38:29 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:38:29 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:38:29 user nova-compute[70914]:       <source dev="/dev/sdd"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:       <serial>fdda580b-8b57-4531-99c1-282ed9b0465d</serial>
Jul 27 13:38:29 user nova-compute[70914]:     </disk>
Jul 27 13:38:29 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:38:29 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:38:29 user nova-compute[70914]:       <source dev="/dev/sde"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="vdc" bus="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:       <serial>176decad-0adf-410c-830e-5bc4cc0ea19d</serial>
Jul 27 13:38:29 user nova-compute[70914]:     </disk>
Jul 27 13:38:29 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:38:29 user nova-compute[70914]:       <mac address="fa:16:3e:a7:aa:13"/>
Jul 27 13:38:29 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="tap34f538a9-8a"/>
Jul 27 13:38:29 user nova-compute[70914]:     </interface>
Jul 27 13:38:29 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:38:29 user nova-compute[70914]:       <mac address="fa:16:3e:c0:d7:bc"/>
Jul 27 13:38:29 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="tap7b6d11f3-e8"/>
Jul 27 13:38:29 user nova-compute[70914]:     </interface>
Jul 27 13:38:29 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:38:29 user nova-compute[70914]:       <mac address="fa:16:3e:68:4a:03"/>
Jul 27 13:38:29 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="tap4e8a50a8-25"/>
Jul 27 13:38:29 user nova-compute[70914]:     </interface>
Jul 27 13:38:29 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:38:29 user nova-compute[70914]:       <mac address="fa:16:3e:16:bf:b4"/>
Jul 27 13:38:29 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="tapcf2cbb47-3c"/>
Jul 27 13:38:29 user nova-compute[70914]:     </interface>
Jul 27 13:38:29 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:38:29 user nova-compute[70914]:       <mac address="fa:16:3e:73:80:45"/>
Jul 27 13:38:29 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="tap07a5fb68-24"/>
Jul 27 13:38:29 user nova-compute[70914]:     </interface>
Jul 27 13:38:29 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:38:29 user nova-compute[70914]:       <mac address="fa:16:3e:cc:f8:aa"/>
Jul 27 13:38:29 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="tap3621c1af-c3"/>
Jul 27 13:38:29 user nova-compute[70914]:     </interface>
Jul 27 13:38:29 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:38:29 user nova-compute[70914]:       <mac address="fa:16:3e:4f:46:a1"/>
Jul 27 13:38:29 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:38:29 user nova-compute[70914]:       <target dev="tap34242348-5f"/>
Jul 27 13:38:29 user nova-compute[70914]:     </interface>
Jul 27 13:38:29 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:38:29 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/5282ea2a-f5f3-423e-980c-d80a8b7405fd/console.log" append="off"/>
Jul 27 13:38:29 user nova-compute[70914]:     </serial>
Jul 27 13:38:29 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:38:29 user nova-compute[70914]:     <video>
Jul 27 13:38:29 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:29 user nova-compute[70914]:     </video>
Jul 27 13:38:29 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:38:29 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:38:29 user nova-compute[70914]:     </rng>
Jul 27 13:38:29 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:38:29 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:38:29 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:38:29 user nova-compute[70914]:     </memballoon>
Jul 27 13:38:29 user nova-compute[70914]:   </devices>
Jul 27 13:38:29 user nova-compute[70914]: </domain>
Jul 27 13:38:29 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:aa:13,bridge_name='br-int',has_traffic_filtering=True,id=34f538a9-8a9c-47a8-8aae-5a96279d31d5,network=Network(07f3571f-9eb1-405a-b8f2-ad5713e12021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f538a9-8a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:aa:13,bridge_name='br-int',has_traffic_filtering=True,id=34f538a9-8a9c-47a8-8aae-5a96279d31d5,network=Network(07f3571f-9eb1-405a-b8f2-ad5713e12021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f538a9-8a') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e658f6-4b3d-4005-b7dd-829f33aea2a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34f538a9-8a, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34f538a9-8a, col_values=(('external_ids', {'iface-id': '34f538a9-8a9c-47a8-8aae-5a96279d31d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:aa:13', 'vm-uuid': '5282ea2a-f5f3-423e-980c-d80a8b7405fd'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[380709eb-c366-4053-9923-86921bd0ce2d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:29 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:29 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:29 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:38:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 (non-flash)
Jul 27 13:38:29 user nova-compute[70914]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:29 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:29 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:38:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18170160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: INFO os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:aa:13,bridge_name='br-int',has_traffic_filtering=True,id=34f538a9-8a9c-47a8-8aae-5a96279d31d5,network=Network(07f3571f-9eb1-405a-b8f2-ad5713e12021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f538a9-8a')
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d7:bc,bridge_name='br-int',has_traffic_filtering=True,id=7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6d11f3-e8') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d7:bc,bridge_name='br-int',has_traffic_filtering=True,id=7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6d11f3-e8') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b6d11f3-e8, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b6d11f3-e8, col_values=(('external_ids', {'iface-id': '7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:d7:bc', 'vm-uuid': '5282ea2a-f5f3-423e-980c-d80a8b7405fd'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ef50d0-9b5a-4a9e-8503-42b36661f0ac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe5b61f-cf2b-460c-8de2-e8ea6441d61f]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: INFO os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d7:bc,bridge_name='br-int',has_traffic_filtering=True,id=7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6d11f3-e8')
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=4e8a50a8-25a0-46f7-b454-ca19f327b6b1,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e8a50a8-25') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=4e8a50a8-25a0-46f7-b454-ca19f327b6b1,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e8a50a8-25') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[825bd016-4449-40e7-8e0e-92f464643d1f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e8a50a8-25, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e8a50a8-25, col_values=(('external_ids', {'iface-id': '4e8a50a8-25a0-46f7-b454-ca19f327b6b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:4a:03', 'vm-uuid': '5282ea2a-f5f3-423e-980c-d80a8b7405fd'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9c4c76-bc49-48f2-be8c-0cc4dd0fef21]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: INFO os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=4e8a50a8-25a0-46f7-b454-ca19f327b6b1,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e8a50a8-25')
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:bf:b4,bridge_name='br-int',has_traffic_filtering=True,id=cf2cbb47-3c62-4067-aed5-e1f597744523,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2cbb47-3c') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:bf:b4,bridge_name='br-int',has_traffic_filtering=True,id=cf2cbb47-3c62-4067-aed5-e1f597744523,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2cbb47-3c') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf2cbb47-3c, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf2cbb47-3c, col_values=(('external_ids', {'iface-id': 'cf2cbb47-3c62-4067-aed5-e1f597744523', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:bf:b4', 'vm-uuid': '5282ea2a-f5f3-423e-980c-d80a8b7405fd'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f68152-af98-4579-88bd-448e8dfa7fd3]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: INFO os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:bf:b4,bridge_name='br-int',has_traffic_filtering=True,id=cf2cbb47-3c62-4067-aed5-e1f597744523,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2cbb47-3c')
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:80:45,bridge_name='br-int',has_traffic_filtering=True,id=07a5fb68-24d1-40db-a367-696868645122,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a5fb68-24') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:80:45,bridge_name='br-int',has_traffic_filtering=True,id=07a5fb68-24d1-40db-a367-696868645122,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a5fb68-24') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0622e5-be77-4f3e-a44e-41a283caf640]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05, portal: 172.16.0.220,3260]
Jul 27 13:38:29 user nova-compute[70914]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05, portal: 172.16.0.220,3260] successful.
Jul 27 13:38:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07a5fb68-24, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07a5fb68-24, col_values=(('external_ids', {'iface-id': '07a5fb68-24d1-40db-a367-696868645122', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:80:45', 'vm-uuid': '5282ea2a-f5f3-423e-980c-d80a8b7405fd'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806ae18e-971f-4197-b54f-6ceb00807c05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb86eef-6867-4e57-b94c-44417dc2e8c2]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== disconnect_volume: return (1399ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: INFO os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:80:45,bridge_name='br-int',has_traffic_filtering=True,id=07a5fb68-24d1-40db-a367-696868645122,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a5fb68-24')
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:aa,bridge_name='br-int',has_traffic_filtering=True,id=3621c1af-c3c1-4fa9-b948-1c0930d2157a,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3621c1af-c3') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:aa,bridge_name='br-int',has_traffic_filtering=True,id=3621c1af-c3c1-4fa9-b948-1c0930d2157a,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3621c1af-c3') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3621c1af-c3, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3621c1af-c3, col_values=(('external_ids', {'iface-id': '3621c1af-c3c1-4fa9-b948-1c0930d2157a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f8:aa', 'vm-uuid': '5282ea2a-f5f3-423e-980c-d80a8b7405fd'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: INFO os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:aa,bridge_name='br-int',has_traffic_filtering=True,id=3621c1af-c3c1-4fa9-b948-1c0930d2157a,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3621c1af-c3')
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:46:a1,bridge_name='br-int',has_traffic_filtering=True,id=34242348-5fb7-4cf9-9d10-069ccec48e42,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34242348-5f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:46:a1,bridge_name='br-int',has_traffic_filtering=True,id=34242348-5fb7-4cf9-9d10-069ccec48e42,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34242348-5f') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34242348-5f, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34242348-5f, col_values=(('external_ids', {'iface-id': '34242348-5fb7-4cf9-9d10-069ccec48e42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:46:a1', 'vm-uuid': '5282ea2a-f5f3-423e-980c-d80a8b7405fd'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:29 user nova-compute[70914]: INFO os_vif [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:46:a1,bridge_name='br-int',has_traffic_filtering=True,id=34242348-5fb7-4cf9-9d10-069ccec48e42,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34242348-5f')
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] No BDM found with device name hda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] No VIF found with MAC fa:16:3e:a7:aa:13, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:38:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] No VIF found with MAC fa:16:3e:73:80:45, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:38:29 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Using config drive
Jul 27 13:38:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Creating config drive at /opt/stack/data/nova/instances/5282ea2a-f5f3-423e-980c-d80a8b7405fd/disk.config
Jul 27 13:38:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5282ea2a-f5f3-423e-980c-d80a8b7405fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpszihcf1u {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5282ea2a-f5f3-423e-980c-d80a8b7405fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpszihcf1u" returned: 0 in 0.074s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4b2f9329-75e1-476b-9105-6fe78e81213b tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.938s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.330s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Starting finish_revert_migration {{(pid=70914) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Start _get_guest_xml network_info=[{"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '878dabe3-8613-4d1b-bc60-9936c7c96bbc', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '38108984-8bd8-49b6-9111-33c084a5a16a', 'attached_at': '2023-07-27T13:38:31.000000', 'detached_at': '', 'volume_id': '0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'serial': '0df6dc3b-018b-4dfb-afb9-6a2efcda4b98'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:38:31 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:38:31 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'vcpu_model' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:38:31 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:31 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:38:31 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f1b91-7a76-4410-890e-bd4af20d1ff1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:38:31 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faff39b-2efe-4d15-9b1a-e447a9ff96ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98] added
Jul 27 13:38:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a5e41c-3d5a-413f-967e-fec4aa5f6381]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8ab114-364e-4659-86b8-a6e3688a6f5e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgeofZBA {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgeofZBA" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2b3580-52c8-4b7c-9df1-aacb2846c683]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgeofZBA'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9ad96b-f01e-41ec-91b5-cce6c3cf5445]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3533390-c824-4f9d-bda0-501b2c31e17c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:31 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:31 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:38:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:31 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:31 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:38:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6faef7-f464-4e8e-9062-e214fd5dfef2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]
Jul 27 13:38:31 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.
Jul 27 13:38:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3a7da5-5c24-426b-8a68-662ddb755ed8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[684b7507-b830-42e4-a7be-0368a7ef6bff]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:31 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:31 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:38:31 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:38:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:38:31 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:38:31 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:38:31 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:38:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da40636-790b-49be-84cc-6622aeccbc5b]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-58d19420-a26a-407d-b71b-ff9c185eb9fe req-a2abec95-d207-4c57-a4aa-3db4bce179b0 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-58d19420-a26a-407d-b71b-ff9c185eb9fe req-a2abec95-d207-4c57-a4aa-3db4bce179b0 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-58d19420-a26a-407d-b71b-ff9c185eb9fe req-a2abec95-d207-4c57-a4aa-3db4bce179b0 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-58d19420-a26a-407d-b71b-ff9c185eb9fe req-a2abec95-d207-4c57-a4aa-3db4bce179b0 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-58d19420-a26a-407d-b71b-ff9c185eb9fe req-a2abec95-d207-4c57-a4aa-3db4bce179b0 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:31 user nova-compute[70914]: WARNING nova.compute.manager [req-58d19420-a26a-407d-b71b-ff9c185eb9fe req-a2abec95-d207-4c57-a4aa-3db4bce179b0 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 for instance with vm_state building and task_state spawning.
Jul 27 13:38:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-64c891e9-8477-45f3-922f-0a8d37500918 req-b8e644c1-1bcd-455c-85de-1d74a2f85721 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-64c891e9-8477-45f3-922f-0a8d37500918 req-b8e644c1-1bcd-455c-85de-1d74a2f85721 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-64c891e9-8477-45f3-922f-0a8d37500918 req-b8e644c1-1bcd-455c-85de-1d74a2f85721 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-64c891e9-8477-45f3-922f-0a8d37500918 req-b8e644c1-1bcd-455c-85de-1d74a2f85721 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-64c891e9-8477-45f3-922f-0a8d37500918 req-b8e644c1-1bcd-455c-85de-1d74a2f85721 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:32 user nova-compute[70914]: WARNING nova.compute.manager [req-64c891e9-8477-45f3-922f-0a8d37500918 req-b8e644c1-1bcd-455c-85de-1d74a2f85721 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 for instance with vm_state building and task_state spawning.
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23363353465353932', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363353465353932', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1925007786',display_name='tempest-ServerActionsTestOtherB-server-1925007786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1925007786',id=5,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHExeREDDPpeeto4dRdX/RKJZ83dPJH4sXgXTDLxmQ+8ZlOJR2MBG7t/gorV67US4l275/41OOOBwoDR8FgADW9jHIAHwwSPLUWO/b4tEzLREH2uqa5IWe2ftSKsaPh2Hw==',key_name='tempest-keypair-168588775',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a180220b142349188245dd88298da020',ramdisk_id='',reservation_id='r-so1tb3rb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-874236545',owner_user_name='tempest-ServerActionsTestOtherB-874236545-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe9d73d3e87c4ad4a1ff9afb4ee6a9b0',uuid=38108984-8bd8-49b6-9111-33c084a5a16a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converting VIF {"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:38:32 user nova-compute[70914]:   <uuid>38108984-8bd8-49b6-9111-33c084a5a16a</uuid>
Jul 27 13:38:32 user nova-compute[70914]:   <name>instance-00000005</name>
Jul 27 13:38:32 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:38:32 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:38:32 user nova-compute[70914]:   <metadata>
Jul 27 13:38:32 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:38:32 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:38:32 user nova-compute[70914]:       <nova:name>tempest-ServerActionsTestOtherB-server-1925007786</nova:name>
Jul 27 13:38:32 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:38:31</nova:creationTime>
Jul 27 13:38:32 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:38:32 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:38:32 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:38:32 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:38:32 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:38:32 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:38:32 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:38:32 user nova-compute[70914]:       <nova:owner>
Jul 27 13:38:32 user nova-compute[70914]:         <nova:user uuid="fe9d73d3e87c4ad4a1ff9afb4ee6a9b0">tempest-ServerActionsTestOtherB-874236545-project-member</nova:user>
Jul 27 13:38:32 user nova-compute[70914]:         <nova:project uuid="a180220b142349188245dd88298da020">tempest-ServerActionsTestOtherB-874236545</nova:project>
Jul 27 13:38:32 user nova-compute[70914]:       </nova:owner>
Jul 27 13:38:32 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:38:32 user nova-compute[70914]:       <nova:ports>
Jul 27 13:38:32 user nova-compute[70914]:         <nova:port uuid="ae2390d8-702c-478a-8f63-ff3c36403dc3">
Jul 27 13:38:32 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 13:38:32 user nova-compute[70914]:         </nova:port>
Jul 27 13:38:32 user nova-compute[70914]:       </nova:ports>
Jul 27 13:38:32 user nova-compute[70914]:     </nova:instance>
Jul 27 13:38:32 user nova-compute[70914]:   </metadata>
Jul 27 13:38:32 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:38:32 user nova-compute[70914]:     <system>
Jul 27 13:38:32 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:38:32 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:38:32 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:38:32 user nova-compute[70914]:       <entry name="serial">38108984-8bd8-49b6-9111-33c084a5a16a</entry>
Jul 27 13:38:32 user nova-compute[70914]:       <entry name="uuid">38108984-8bd8-49b6-9111-33c084a5a16a</entry>
Jul 27 13:38:32 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:38:32 user nova-compute[70914]:     </system>
Jul 27 13:38:32 user nova-compute[70914]:   </sysinfo>
Jul 27 13:38:32 user nova-compute[70914]:   <os>
Jul 27 13:38:32 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:38:32 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:38:32 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:38:32 user nova-compute[70914]:   </os>
Jul 27 13:38:32 user nova-compute[70914]:   <features>
Jul 27 13:38:32 user nova-compute[70914]:     <acpi/>
Jul 27 13:38:32 user nova-compute[70914]:     <apic/>
Jul 27 13:38:32 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:38:32 user nova-compute[70914]:   </features>
Jul 27 13:38:32 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:38:32 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:38:32 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:38:32 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:38:32 user nova-compute[70914]:   </clock>
Jul 27 13:38:32 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:38:32 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:38:32 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:38:32 user nova-compute[70914]:   </cpu>
Jul 27 13:38:32 user nova-compute[70914]:   <devices>
Jul 27 13:38:32 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:38:32 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:38:32 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk"/>
Jul 27 13:38:32 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:38:32 user nova-compute[70914]:     </disk>
Jul 27 13:38:32 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:38:32 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:38:32 user nova-compute[70914]:       <source dev="/dev/sdb"/>
Jul 27 13:38:32 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:38:32 user nova-compute[70914]:       <serial>0df6dc3b-018b-4dfb-afb9-6a2efcda4b98</serial>
Jul 27 13:38:32 user nova-compute[70914]:     </disk>
Jul 27 13:38:32 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:38:32 user nova-compute[70914]:       <mac address="fa:16:3e:5c:af:6f"/>
Jul 27 13:38:32 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:32 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:38:32 user nova-compute[70914]:       <target dev="tapae2390d8-70"/>
Jul 27 13:38:32 user nova-compute[70914]:     </interface>
Jul 27 13:38:32 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:38:32 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/console.log" append="off"/>
Jul 27 13:38:32 user nova-compute[70914]:     </serial>
Jul 27 13:38:32 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:38:32 user nova-compute[70914]:     <video>
Jul 27 13:38:32 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:38:32 user nova-compute[70914]:     </video>
Jul 27 13:38:32 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:38:32 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:38:32 user nova-compute[70914]:     </rng>
Jul 27 13:38:32 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:38:32 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:38:32 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:38:32 user nova-compute[70914]:     </memballoon>
Jul 27 13:38:32 user nova-compute[70914]:   </devices>
Jul 27 13:38:32 user nova-compute[70914]: </domain>
Jul 27 13:38:32 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1925007786',display_name='tempest-ServerActionsTestOtherB-server-1925007786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1925007786',id=5,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHExeREDDPpeeto4dRdX/RKJZ83dPJH4sXgXTDLxmQ+8ZlOJR2MBG7t/gorV67US4l275/41OOOBwoDR8FgADW9jHIAHwwSPLUWO/b4tEzLREH2uqa5IWe2ftSKsaPh2Hw==',key_name='tempest-keypair-168588775',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a180220b142349188245dd88298da020',ramdisk_id='',reservation_id='r-so1tb3rb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-874236545',owner_user_name='tempest-ServerActionsTestOtherB-874236545-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe9d73d3e87c4ad4a1ff9afb4ee6a9b0',uuid=38108984-8bd8-49b6-9111-33c084a5a16a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converting VIF {"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG os_vif [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae2390d8-70, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae2390d8-70, col_values=(('external_ids', {'iface-id': 'ae2390d8-702c-478a-8f63-ff3c36403dc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:af:6f', 'vm-uuid': '38108984-8bd8-49b6-9111-33c084a5a16a'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: INFO os_vif [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70')
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465098.4459662, 2f25226c-952e-482b-b2c1-77384b67bbed => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:33 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] VM Stopped (Lifecycle Event)
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4c44b8e0-a7e8-4c3e-9615-3e0ef43e0597 None None] [instance: 2f25226c-952e-482b-b2c1-77384b67bbed] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-677a3aa7-c81a-4897-846b-1cc121db276d req-e7a312d4-4ae0-46ab-8025-58ff568d12b9 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-677a3aa7-c81a-4897-846b-1cc121db276d req-e7a312d4-4ae0-46ab-8025-58ff568d12b9 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-677a3aa7-c81a-4897-846b-1cc121db276d req-e7a312d4-4ae0-46ab-8025-58ff568d12b9 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-677a3aa7-c81a-4897-846b-1cc121db276d req-e7a312d4-4ae0-46ab-8025-58ff568d12b9 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-677a3aa7-c81a-4897-846b-1cc121db276d req-e7a312d4-4ae0-46ab-8025-58ff568d12b9 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:33 user nova-compute[70914]: WARNING nova.compute.manager [req-677a3aa7-c81a-4897-846b-1cc121db276d req-e7a312d4-4ae0-46ab-8025-58ff568d12b9 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a for instance with vm_state building and task_state spawning.
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:34 user nova-compute[70914]: WARNING nova.compute.manager [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 for instance with vm_state building and task_state spawning.
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:34 user nova-compute[70914]: WARNING nova.compute.manager [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-cf2cbb47-3c62-4067-aed5-e1f597744523 for instance with vm_state building and task_state spawning.
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:34 user nova-compute[70914]: WARNING nova.compute.manager [req-5befd58b-f4e1-4ebb-8ea1-004adc055dbb req-a57570a9-4422-440f-b3cb-992c6b4bcdcc service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-cf2cbb47-3c62-4067-aed5-e1f597744523 for instance with vm_state building and task_state spawning.
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465098.9992151, 38108984-8bd8-49b6-9111-33c084a5a16a => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:34 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] VM Stopped (Lifecycle Event)
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3cf27615-9d9a-4554-9488-3c31c81b9548 None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:34 user nova-compute[70914]: WARNING nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 for instance with vm_state building and task_state spawning.
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:34 user nova-compute[70914]: WARNING nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 for instance with vm_state building and task_state spawning.
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:34 user nova-compute[70914]: WARNING nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 for instance with vm_state building and task_state spawning.
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:34 user nova-compute[70914]: WARNING nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-07a5fb68-24d1-40db-a367-696868645122 for instance with vm_state building and task_state spawning.
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:34 user nova-compute[70914]: WARNING nova.compute.manager [req-f0457b00-449c-44cc-bfe7-d20806f8954d req-fa5ce1c2-4f04-4825-ba77-f3c1682bebec service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-07a5fb68-24d1-40db-a367-696868645122 for instance with vm_state building and task_state spawning.
Jul 27 13:38:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-0f98dcfa-15fc-4522-990c-77438ded2356 req-8c91878a-0fd3-4921-a95a-b5b110cfcbe8 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0f98dcfa-15fc-4522-990c-77438ded2356 req-8c91878a-0fd3-4921-a95a-b5b110cfcbe8 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0f98dcfa-15fc-4522-990c-77438ded2356 req-8c91878a-0fd3-4921-a95a-b5b110cfcbe8 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0f98dcfa-15fc-4522-990c-77438ded2356 req-8c91878a-0fd3-4921-a95a-b5b110cfcbe8 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-0f98dcfa-15fc-4522-990c-77438ded2356 req-8c91878a-0fd3-4921-a95a-b5b110cfcbe8 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:35 user nova-compute[70914]: WARNING nova.compute.manager [req-0f98dcfa-15fc-4522-990c-77438ded2356 req-8c91878a-0fd3-4921-a95a-b5b110cfcbe8 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a for instance with vm_state building and task_state spawning.
Jul 27 13:38:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:36 user nova-compute[70914]: WARNING nova.compute.manager [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state resized and task_state resize_reverting.
Jul 27 13:38:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:36 user nova-compute[70914]: WARNING nova.compute.manager [req-be2b03b6-238d-4e8a-8bdd-47cb38079eb7 req-772036bb-b9fb-4051-8f47-c87c0b3d1717 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state resized and task_state resize_reverting.
Jul 27 13:38:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:36 user nova-compute[70914]: WARNING nova.compute.manager [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-34242348-5fb7-4cf9-9d10-069ccec48e42 for instance with vm_state building and task_state spawning.
Jul 27 13:38:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:36 user nova-compute[70914]: WARNING nova.compute.manager [req-16125d96-f80d-4abc-bfff-f85cb1bcd9e3 req-f43cc2cc-3ba7-47f8-99f3-bb317bcf2651 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-34242348-5fb7-4cf9-9d10-069ccec48e42 for instance with vm_state building and task_state spawning.
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:38:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465117.3480365, 38108984-8bd8-49b6-9111-33c084a5a16a => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] VM Resumed (Lifecycle Event)
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance running successfully.
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] finish_revert_migration finished successfully. {{(pid=70914) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465117.3529942, 38108984-8bd8-49b6-9111-33c084a5a16a => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] VM Started (Lifecycle Event)
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Instance spawned successfully.
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465102.434076, bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] VM Stopped (Lifecycle Event)
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465117.406367, 5282ea2a-f5f3-423e-980c-d80a8b7405fd => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] VM Resumed (Lifecycle Event)
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-2d1b03ec-ec43-4e9c-99d4-a73b6d8d1695 None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-2d1b03ec-ec43-4e9c-99d4-a73b6d8d1695 None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465117.4079242, 5282ea2a-f5f3-423e-980c-d80a8b7405fd => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] VM Started (Lifecycle Event)
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-62d01329-5dca-46f3-90af-5dfb63208aa7 tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating instance to original state: 'active'
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Took 12.82 seconds to spawn the instance on the hypervisor.
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:38:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Took 39.42 seconds to build instance.
Jul 27 13:38:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0b31eeb0-17c0-4129-9199-643b88fca788 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.506s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.615s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:37 user nova-compute[70914]: INFO nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:38:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:38 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:38:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:38 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:38:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:42 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:38:42 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:38:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7368MB free_disk=25.558757781982422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance d54b6163-cc14-44d4-91c6-d306168bb875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 509e7547-8472-4954-8fc6-a152e9667437 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 5282ea2a-f5f3-423e-980c-d80a8b7405fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 10fa8c48-a95a-411f-9de0-aabf19455f57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 38108984-8bd8-49b6-9111-33c084a5a16a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:38:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:45 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:38:45 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:38:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:38:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 13:38:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:38:45 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:46 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updating instance_info_cache with network_info: [{"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:38:46 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:38:46 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:38:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:52 user nova-compute[70914]: INFO nova.compute.manager [None req-b6201b1f-0af8-4f78-bdd2-bebc4c6b955e tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Unrescuing
Jul 27 13:38:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b6201b1f-0af8-4f78-bdd2-bebc4c6b955e tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:38:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b6201b1f-0af8-4f78-bdd2-bebc4c6b955e tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquired lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:38:52 user nova-compute[70914]: DEBUG nova.network.neutron [None req-b6201b1f-0af8-4f78-bdd2-bebc4c6b955e tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:38:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:38:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:38:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:38:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:38:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-b6201b1f-0af8-4f78-bdd2-bebc4c6b955e tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updating instance_info_cache with network_info: [{"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b6201b1f-0af8-4f78-bdd2-bebc4c6b955e tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Releasing lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG nova.objects.instance [None req-b6201b1f-0af8-4f78-bdd2-bebc4c6b955e tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'flavor' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-1ce9089e-3557-496c-8d1c-771d8ba29a20 req-b0b42c43-5550-441e-8850-7e5313c66bc3 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1ce9089e-3557-496c-8d1c-771d8ba29a20 req-b0b42c43-5550-441e-8850-7e5313c66bc3 service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1ce9089e-3557-496c-8d1c-771d8ba29a20 req-b0b42c43-5550-441e-8850-7e5313c66bc3 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1ce9089e-3557-496c-8d1c-771d8ba29a20 req-b0b42c43-5550-441e-8850-7e5313c66bc3 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-1ce9089e-3557-496c-8d1c-771d8ba29a20 req-b0b42c43-5550-441e-8850-7e5313c66bc3 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:53 user nova-compute[70914]: WARNING nova.compute.manager [req-1ce9089e-3557-496c-8d1c-771d8ba29a20 req-b0b42c43-5550-441e-8850-7e5313c66bc3 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:38:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:54 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Instance destroyed successfully.
Jul 27 13:38:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-dbac20b3-c452-401a-ad4d-7789c278c84e req-1732c2b6-eef9-42b5-98a4-ec55bb20050d service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dbac20b3-c452-401a-ad4d-7789c278c84e req-1732c2b6-eef9-42b5-98a4-ec55bb20050d service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dbac20b3-c452-401a-ad4d-7789c278c84e req-1732c2b6-eef9-42b5-98a4-ec55bb20050d service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dbac20b3-c452-401a-ad4d-7789c278c84e req-1732c2b6-eef9-42b5-98a4-ec55bb20050d service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-dbac20b3-c452-401a-ad4d-7789c278c84e req-1732c2b6-eef9-42b5-98a4-ec55bb20050d service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:55 user nova-compute[70914]: WARNING nova.compute.manager [req-dbac20b3-c452-401a-ad4d-7789c278c84e req-1732c2b6-eef9-42b5-98a4-ec55bb20050d service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:38:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:57 user nova-compute[70914]: WARNING nova.compute.manager [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:38:57 user nova-compute[70914]: WARNING nova.compute.manager [req-3e1259ea-4538-4f1f-ad3f-240c546042fb req-d3d7a5ea-47b4-45ca-906a-dd3f32e1a7c6 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for 1b676522-c547-497a-9b3b-8436f85c7f40 due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465137.8731582, 1b676522-c547-497a-9b3b-8436f85c7f40 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:57 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] VM Resumed (Lifecycle Event)
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b6201b1f-0af8-4f78-bdd2-bebc4c6b955e tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:38:57 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465137.874111, 1b676522-c547-497a-9b3b-8436f85c7f40 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:38:57 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] VM Started (Lifecycle Event)
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:38:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:38:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-84a441d9-2149-4441-8aa0-c4ac700b74a4 req-0576988f-4232-413b-91a2-f58808ad307e service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-changed-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-84a441d9-2149-4441-8aa0-c4ac700b74a4 req-0576988f-4232-413b-91a2-f58808ad307e service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Refreshing instance network info cache due to event network-changed-31f7f5f5-e982-4083-a3dd-48fd7e526cd5. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:39:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-84a441d9-2149-4441-8aa0-c4ac700b74a4 req-0576988f-4232-413b-91a2-f58808ad307e service nova] Acquiring lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:39:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-84a441d9-2149-4441-8aa0-c4ac700b74a4 req-0576988f-4232-413b-91a2-f58808ad307e service nova] Acquired lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:39:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-84a441d9-2149-4441-8aa0-c4ac700b74a4 req-0576988f-4232-413b-91a2-f58808ad307e service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Refreshing network info cache for port 31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:39:04 user nova-compute[70914]: DEBUG nova.network.neutron [req-84a441d9-2149-4441-8aa0-c4ac700b74a4 req-0576988f-4232-413b-91a2-f58808ad307e service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updated VIF entry in instance network info cache for port 31f7f5f5-e982-4083-a3dd-48fd7e526cd5. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:39:04 user nova-compute[70914]: DEBUG nova.network.neutron [req-84a441d9-2149-4441-8aa0-c4ac700b74a4 req-0576988f-4232-413b-91a2-f58808ad307e service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updating instance_info_cache with network_info: [{"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:39:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-84a441d9-2149-4441-8aa0-c4ac700b74a4 req-0576988f-4232-413b-91a2-f58808ad307e service nova] Releasing lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:39:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "d54b6163-cc14-44d4-91c6-d306168bb875" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "d54b6163-cc14-44d4-91c6-d306168bb875" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:08 user nova-compute[70914]: INFO nova.compute.manager [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Terminating instance
Jul 27 13:39:08 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:39:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-6a27a604-c90a-4838-b67c-dc5064e201fa req-301892bd-41b5-4667-9825-04c4dc3269cd service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received event network-vif-unplugged-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6a27a604-c90a-4838-b67c-dc5064e201fa req-301892bd-41b5-4667-9825-04c4dc3269cd service nova] Acquiring lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6a27a604-c90a-4838-b67c-dc5064e201fa req-301892bd-41b5-4667-9825-04c4dc3269cd service nova] Lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6a27a604-c90a-4838-b67c-dc5064e201fa req-301892bd-41b5-4667-9825-04c4dc3269cd service nova] Lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-6a27a604-c90a-4838-b67c-dc5064e201fa req-301892bd-41b5-4667-9825-04c4dc3269cd service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] No waiting events found dispatching network-vif-unplugged-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-6a27a604-c90a-4838-b67c-dc5064e201fa req-301892bd-41b5-4667-9825-04c4dc3269cd service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received event network-vif-unplugged-fc055a55-b554-442d-916b-59d5fbcd9868 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:39:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Instance destroyed successfully.
Jul 27 13:39:09 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lazy-loading 'resources' on Instance uuid d54b6163-cc14-44d4-91c6-d306168bb875 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1449190881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1449190881',id=7,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7SN82N9cHbn8PZ2TblgAVcZK0sG7UtXb4Z0VqVsC+Osl9+TR/LPm528kEW2qOsoj5UA5deDbyei2ofs9ec+lhrjzD1LESWEf6ptFZmyTIg81cYRyn+BKnc/rNS6rux7Q==',key_name='tempest-keypair-2139703863',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4c94597dacc420abba408e3b60f4a40',ramdisk_id='',reservation_id='r-xre3w9py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1997290170',owner_user_name='tempest-ServerActionsV293TestJSON-1997290170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9279e1abc6946bc970fa3b2b2119c67',uuid=d54b6163-cc14-44d4-91c6-d306168bb875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converting VIF {"id": "fc055a55-b554-442d-916b-59d5fbcd9868", "address": "fa:16:3e:a4:fa:fb", "network": {"id": "ef0106ee-e363-4dd2-9c12-28693bdc54b0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-549727252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c94597dacc420abba408e3b60f4a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc055a55-b5", "ovs_interfaceid": "fc055a55-b554-442d-916b-59d5fbcd9868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:fa:fb,bridge_name='br-int',has_traffic_filtering=True,id=fc055a55-b554-442d-916b-59d5fbcd9868,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc055a55-b5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG os_vif [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:fa:fb,bridge_name='br-int',has_traffic_filtering=True,id=fc055a55-b554-442d-916b-59d5fbcd9868,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc055a55-b5') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc055a55-b5, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:09 user nova-compute[70914]: INFO os_vif [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:fa:fb,bridge_name='br-int',has_traffic_filtering=True,id=fc055a55-b554-442d-916b-59d5fbcd9868,network=Network(ef0106ee-e363-4dd2-9c12-28693bdc54b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc055a55-b5')
Jul 27 13:39:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Deleting instance files /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875_del
Jul 27 13:39:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Deletion of /opt/stack/data/nova/instances/d54b6163-cc14-44d4-91c6-d306168bb875_del complete
Jul 27 13:39:09 user nova-compute[70914]: INFO nova.compute.manager [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Took 0.69 seconds to destroy the instance on the hypervisor.
Jul 27 13:39:09 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:39:09 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:39:10 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:39:10 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Took 1.00 seconds to deallocate network for instance.
Jul 27 13:39:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-fe8b863e-a0fd-4822-9b17-318e993cb423 req-decfd790-53f5-4e9a-aa97-bb28a3d10786 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received event network-vif-deleted-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:10 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:39:10 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:39:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:10 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Deleted allocations for instance d54b6163-cc14-44d4-91c6-d306168bb875
Jul 27 13:39:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d718adff-d56a-480b-8227-b687c20d8df7 tempest-ServerActionsV293TestJSON-1997290170 tempest-ServerActionsV293TestJSON-1997290170-project-member] Lock "d54b6163-cc14-44d4-91c6-d306168bb875" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.215s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-e700479f-2e98-4619-b4be-26b049ae17b1 req-0e7f76e0-9fcf-46e0-9e72-08bb7845eec0 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received event network-vif-plugged-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e700479f-2e98-4619-b4be-26b049ae17b1 req-0e7f76e0-9fcf-46e0-9e72-08bb7845eec0 service nova] Acquiring lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e700479f-2e98-4619-b4be-26b049ae17b1 req-0e7f76e0-9fcf-46e0-9e72-08bb7845eec0 service nova] Lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e700479f-2e98-4619-b4be-26b049ae17b1 req-0e7f76e0-9fcf-46e0-9e72-08bb7845eec0 service nova] Lock "d54b6163-cc14-44d4-91c6-d306168bb875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-e700479f-2e98-4619-b4be-26b049ae17b1 req-0e7f76e0-9fcf-46e0-9e72-08bb7845eec0 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] No waiting events found dispatching network-vif-plugged-fc055a55-b554-442d-916b-59d5fbcd9868 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:11 user nova-compute[70914]: WARNING nova.compute.manager [req-e700479f-2e98-4619-b4be-26b049ae17b1 req-0e7f76e0-9fcf-46e0-9e72-08bb7845eec0 service nova] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Received unexpected event network-vif-plugged-fc055a55-b554-442d-916b-59d5fbcd9868 for instance with vm_state deleted and task_state None.
Jul 27 13:39:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:39:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:23 user nova-compute[70914]: INFO nova.compute.manager [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attaching volume 46dc5c8a-c815-4bb6-8813-884d7ba16c30 to /dev/vdb
Jul 27 13:39:23 user nova-compute[70914]: DEBUG os_brick.utils [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aee0c9-edd1-4af8-9bc5-39927487f589]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2e0922-e9c2-4395-aa8e-be0ab0e85ae4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4f196d-1988-4909-bc44-19a680d06533]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb98bbcd-ea22-4cbc-8e19-94f29da02d47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:39:24 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:39:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[19205ccd-d6a4-4c7a-a1fe-7cb66f3e5805]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG os_brick.utils [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Updating existing volume attachment record: b5f17f7d-8cb5-4fb4-85f5-cd68e7b27527 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465149.395867, d54b6163-cc14-44d4-91c6-d306168bb875 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:39:24 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] VM Stopped (Lifecycle Event)
Jul 27 13:39:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e508226a-e21c-436d-a9f8-2b4aa8287742 None None] [instance: d54b6163-cc14-44d4-91c6-d306168bb875] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:39:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkIAPVcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:39:31 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:39:31 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:39:31 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a252105-e55c-4c4d-b31e-84f477175e46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:39:31 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[146f7023-a0df-46de-ba27-719b773f0622]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30] added
Jul 27 13:39:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb0c080-0c29-444e-8eb2-9b192c5059c5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[45595a10-8ce3-4838-b9ae-428ce2da936c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkIAPVcT {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkIAPVcT" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f32e429-49a4-4446-8637-737b88923a99]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CkIAPVcT'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45f304f-e6ae-4a94-a870-4f7a30a701dd]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[83878b5b-d7ca-43d5-a8de-10877a4509ce]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ce6ce7-8615-41df-9f91-19fbbab8fd32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30, portal: 172.16.0.220,3260]
Jul 27 13:39:31 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30, portal: 172.16.0.220,3260] successful.
Jul 27 13:39:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd098831-e519-4e1b-8e3f-d8fa768978d0]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[597ab2c3-dfce-41b7-98fc-fdf955d52934]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 (non-flash)
Jul 27 13:39:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:31 user nova-compute[70914]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 (non-flash)
Jul 27 13:39:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4996ffa2-92e1-4c4a-b757-5a2703fc4cc2]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:39:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkIAPVcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:39:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:39:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23937373965366433', 'path': '/dev/sdf'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:39:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937373965366433', 'path': '/dev/sdf'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:39:32 user nova-compute[70914]: DEBUG nova.objects.instance [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:39:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:39:32 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:39:32 user nova-compute[70914]:   <source dev="/dev/sdf"/>
Jul 27 13:39:32 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:39:32 user nova-compute[70914]:   <serial>46dc5c8a-c815-4bb6-8813-884d7ba16c30</serial>
Jul 27 13:39:32 user nova-compute[70914]: </disk>
Jul 27 13:39:32 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:39:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:39:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:39:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No VIF found with MAC fa:16:3e:a7:1a:64, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:39:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-463b1f8b-9734-458b-bfb6-1cee7ab8ace9 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.016s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:35 user nova-compute[70914]: INFO nova.compute.manager [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Detaching volume 46dc5c8a-c815-4bb6-8813-884d7ba16c30
Jul 27 13:39:35 user nova-compute[70914]: INFO nova.virt.block_device [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attempting to driver detach volume 46dc5c8a-c815-4bb6-8813-884d7ba16c30 from mountpoint /dev/vdb
Jul 27 13:39:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Attempting to detach device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:39:35 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:39:35 user nova-compute[70914]:   <source dev="/dev/sdf"/>
Jul 27 13:39:35 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:39:35 user nova-compute[70914]:   <serial>46dc5c8a-c815-4bb6-8813-884d7ba16c30</serial>
Jul 27 13:39:35 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:39:35 user nova-compute[70914]: </disk>
Jul 27 13:39:35 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:39:35 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Successfully detached device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the persistent domain config.
Jul 27 13:39:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:39:35 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:39:35 user nova-compute[70914]:   <source dev="/dev/sdf"/>
Jul 27 13:39:35 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:39:35 user nova-compute[70914]:   <serial>46dc5c8a-c815-4bb6-8813-884d7ba16c30</serial>
Jul 27 13:39:35 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:39:35 user nova-compute[70914]: </disk>
Jul 27 13:39:35 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465175.94532, 72a9344d-135a-4283-b42e-cf0e5fb4bc75 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:39:35 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Successfully detached device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the live domain config.
Jul 27 13:39:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkIAPVcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:39:35 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:39:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b802d81-b72c-4eba-af29-7a84ad26987e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:39:35 user nova-compute[70914]: No targets found.
Jul 27 13:39:35 user nova-compute[70914]: iSNS:
Jul 27 13:39:35 user nova-compute[70914]: No targets found.
Jul 27 13:39:35 user nova-compute[70914]: STATIC:
Jul 27 13:39:35 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c
Jul 27 13:39:35 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:35 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:35 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:39:35 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:35 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:35 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d
Jul 27 13:39:35 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:35 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:35 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30
Jul 27 13:39:35 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:35 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:35 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d
Jul 27 13:39:35 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:35 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:35 user nova-compute[70914]: FIRMWARE:
Jul 27 13:39:35 user nova-compute[70914]: No targets found.
Jul 27 13:39:35 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:39:35 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:39:35 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:39:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a5ffa-d023-4fda-bc0b-8a000063e83a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[642bb585-4d5e-495e-9d25-eced5bb6c209]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:39:36 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:39:36 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:36 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:36 user nova-compute[70914]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 (non-flash)
Jul 27 13:39:36 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:39:36 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:39:36 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:36 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:36 user nova-compute[70914]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 (non-flash)
Jul 27 13:39:36 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c474b1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30'): ({'sdf'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Removing single pathed devices sdf {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6133da-88b0-4d00-9c0e-e045927098d8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2231ce19-ac47-459d-bacb-dee0c204efc9]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Flushing IO for device /dev/sdf {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da33d9b-7616-4ab9-a43a-91fd34dcdb06]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[492754af-4eeb-422c-8cfa-14fcfe978dd6]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] SCSI volumes sdf have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7315a864-c567-48dd-b02f-00921d966885]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[435ed5fd-73c0-4b0c-953c-615ad0fa1640]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30, portal: 172.16.0.220,3260]
Jul 27 13:39:36 user nova-compute[70914]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30, portal: 172.16.0.220,3260] successful.
Jul 27 13:39:36 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46dc5c8a-c815-4bb6-8813-884d7ba16c30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfcff4b-6473-41d2-a154-39b0c2819ac7]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== disconnect_volume: return (364ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:39:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:39:37 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:39:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d1fde7ea-c7e8-4f05-ab63-b65c06ce46a3 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.769s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:37 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:39:38 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:39:38 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:39:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:38 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:39:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:39:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:39:42 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:39:42 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7335MB free_disk=25.584049224853516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 38108984-8bd8-49b6-9111-33c084a5a16a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 509e7547-8472-4954-8fc6-a152e9667437 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 5282ea2a-f5f3-423e-980c-d80a8b7405fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 10fa8c48-a95a-411f-9de0-aabf19455f57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:39:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:39:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:39:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:39:43 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:39:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:39:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:39:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:39:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updating instance_info_cache with network_info: [{"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:39:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:39:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:39:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:39:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:39:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:39:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-41ad33f1-c95b-44b6-b061-c157588d5427 req-3cd3b3a0-1fff-4290-8f3d-786f2b907d01 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-changed-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-41ad33f1-c95b-44b6-b061-c157588d5427 req-3cd3b3a0-1fff-4290-8f3d-786f2b907d01 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing instance network info cache due to event network-changed-34f538a9-8a9c-47a8-8aae-5a96279d31d5. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:39:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-41ad33f1-c95b-44b6-b061-c157588d5427 req-3cd3b3a0-1fff-4290-8f3d-786f2b907d01 service nova] Acquiring lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:39:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-41ad33f1-c95b-44b6-b061-c157588d5427 req-3cd3b3a0-1fff-4290-8f3d-786f2b907d01 service nova] Acquired lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:39:48 user nova-compute[70914]: DEBUG nova.network.neutron [req-41ad33f1-c95b-44b6-b061-c157588d5427 req-3cd3b3a0-1fff-4290-8f3d-786f2b907d01 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Refreshing network info cache for port 34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:39:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:49 user nova-compute[70914]: DEBUG nova.network.neutron [req-41ad33f1-c95b-44b6-b061-c157588d5427 req-3cd3b3a0-1fff-4290-8f3d-786f2b907d01 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updated VIF entry in instance network info cache for port 34f538a9-8a9c-47a8-8aae-5a96279d31d5. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:39:49 user nova-compute[70914]: DEBUG nova.network.neutron [req-41ad33f1-c95b-44b6-b061-c157588d5427 req-3cd3b3a0-1fff-4290-8f3d-786f2b907d01 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [{"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:39:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-41ad33f1-c95b-44b6-b061-c157588d5427 req-3cd3b3a0-1fff-4290-8f3d-786f2b907d01 service nova] Releasing lock "refresh_cache-5282ea2a-f5f3-423e-980c-d80a8b7405fd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:39:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:51 user nova-compute[70914]: INFO nova.compute.manager [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Terminating instance
Jul 27 13:39:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-e1829420-dbe7-42c6-bd0d-b975f708f8b8 req-b857e97c-cbea-4fb0-b07d-1b7b3031d67c service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received event network-changed-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-e1829420-dbe7-42c6-bd0d-b975f708f8b8 req-b857e97c-cbea-4fb0-b07d-1b7b3031d67c service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Refreshing instance network info cache due to event network-changed-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e1829420-dbe7-42c6-bd0d-b975f708f8b8 req-b857e97c-cbea-4fb0-b07d-1b7b3031d67c service nova] Acquiring lock "refresh_cache-10fa8c48-a95a-411f-9de0-aabf19455f57" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e1829420-dbe7-42c6-bd0d-b975f708f8b8 req-b857e97c-cbea-4fb0-b07d-1b7b3031d67c service nova] Acquired lock "refresh_cache-10fa8c48-a95a-411f-9de0-aabf19455f57" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-e1829420-dbe7-42c6-bd0d-b975f708f8b8 req-b857e97c-cbea-4fb0-b07d-1b7b3031d67c service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Refreshing network info cache for port 57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-6cfae466-8151-4257-83a9-2b1b7fc2c93d req-73375c4d-4a17-4f8e-ae64-e225c076dd0a service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6cfae466-8151-4257-83a9-2b1b7fc2c93d req-73375c4d-4a17-4f8e-ae64-e225c076dd0a service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6cfae466-8151-4257-83a9-2b1b7fc2c93d req-73375c4d-4a17-4f8e-ae64-e225c076dd0a service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6cfae466-8151-4257-83a9-2b1b7fc2c93d req-73375c4d-4a17-4f8e-ae64-e225c076dd0a service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-6cfae466-8151-4257-83a9-2b1b7fc2c93d req-73375c4d-4a17-4f8e-ae64-e225c076dd0a service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-unplugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-6cfae466-8151-4257-83a9-2b1b7fc2c93d req-73375c4d-4a17-4f8e-ae64-e225c076dd0a service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa5bf4f3-61e1-44bb-a3ad-2e1ffcce59d8 req-f601a4da-8803-4e47-bd60-b989c6c82576 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa5bf4f3-61e1-44bb-a3ad-2e1ffcce59d8 req-f601a4da-8803-4e47-bd60-b989c6c82576 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa5bf4f3-61e1-44bb-a3ad-2e1ffcce59d8 req-f601a4da-8803-4e47-bd60-b989c6c82576 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa5bf4f3-61e1-44bb-a3ad-2e1ffcce59d8 req-f601a4da-8803-4e47-bd60-b989c6c82576 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa5bf4f3-61e1-44bb-a3ad-2e1ffcce59d8 req-f601a4da-8803-4e47-bd60-b989c6c82576 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-unplugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa5bf4f3-61e1-44bb-a3ad-2e1ffcce59d8 req-f601a4da-8803-4e47-bd60-b989c6c82576 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-e1829420-dbe7-42c6-bd0d-b975f708f8b8 req-b857e97c-cbea-4fb0-b07d-1b7b3031d67c service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Updated VIF entry in instance network info cache for port 57228a08-7e4c-4c7b-bbcd-ada78b6ec66e. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-e1829420-dbe7-42c6-bd0d-b975f708f8b8 req-b857e97c-cbea-4fb0-b07d-1b7b3031d67c service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Updating instance_info_cache with network_info: [{"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e1829420-dbe7-42c6-bd0d-b975f708f8b8 req-b857e97c-cbea-4fb0-b07d-1b7b3031d67c service nova] Releasing lock "refresh_cache-10fa8c48-a95a-411f-9de0-aabf19455f57" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:39:52 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Instance destroyed successfully.
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.objects.instance [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lazy-loading 'resources' on Instance uuid 5282ea2a-f5f3-423e-980c-d80a8b7405fd {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:aa:13,bridge_name='br-int',has_traffic_filtering=True,id=34f538a9-8a9c-47a8-8aae-5a96279d31d5,network=Network(07f3571f-9eb1-405a-b8f2-ad5713e12021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f538a9-8a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:aa:13,bridge_name='br-int',has_traffic_filtering=True,id=34f538a9-8a9c-47a8-8aae-5a96279d31d5,network=Network(07f3571f-9eb1-405a-b8f2-ad5713e12021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f538a9-8a') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34f538a9-8a, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: INFO os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:aa:13,bridge_name='br-int',has_traffic_filtering=True,id=34f538a9-8a9c-47a8-8aae-5a96279d31d5,network=Network(07f3571f-9eb1-405a-b8f2-ad5713e12021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f538a9-8a')
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d7:bc,bridge_name='br-int',has_traffic_filtering=True,id=7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6d11f3-e8') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d7:bc,bridge_name='br-int',has_traffic_filtering=True,id=7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6d11f3-e8') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b6d11f3-e8, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: INFO os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d7:bc,bridge_name='br-int',has_traffic_filtering=True,id=7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6d11f3-e8')
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=4e8a50a8-25a0-46f7-b454-ca19f327b6b1,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e8a50a8-25') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=4e8a50a8-25a0-46f7-b454-ca19f327b6b1,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e8a50a8-25') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e8a50a8-25, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: INFO os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=4e8a50a8-25a0-46f7-b454-ca19f327b6b1,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e8a50a8-25')
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:bf:b4,bridge_name='br-int',has_traffic_filtering=True,id=cf2cbb47-3c62-4067-aed5-e1f597744523,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2cbb47-3c') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:bf:b4,bridge_name='br-int',has_traffic_filtering=True,id=cf2cbb47-3c62-4067-aed5-e1f597744523,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2cbb47-3c') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf2cbb47-3c, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-unplugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:53 user nova-compute[70914]: WARNING nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-34f538a9-8a9c-47a8-8aae-5a96279d31d5 for instance with vm_state active and task_state deleting.
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-unplugged-cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-cf2cbb47-3c62-4067-aed5-e1f597744523 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:53 user nova-compute[70914]: WARNING nova.compute.manager [req-fec1f0d6-dc1e-4938-858b-b6682f8a3fea req-11f4bc8a-1a3d-4a4b-97d3-dcea1886cd7e service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-cf2cbb47-3c62-4067-aed5-e1f597744523 for instance with vm_state active and task_state deleting.
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: INFO os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:bf:b4,bridge_name='br-int',has_traffic_filtering=True,id=cf2cbb47-3c62-4067-aed5-e1f597744523,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2cbb47-3c')
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:80:45,bridge_name='br-int',has_traffic_filtering=True,id=07a5fb68-24d1-40db-a367-696868645122,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a5fb68-24') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:80:45,bridge_name='br-int',has_traffic_filtering=True,id=07a5fb68-24d1-40db-a367-696868645122,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a5fb68-24') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07a5fb68-24, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: INFO os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:80:45,bridge_name='br-int',has_traffic_filtering=True,id=07a5fb68-24d1-40db-a367-696868645122,network=Network(b4cb1eaf-b382-4942-982a-d7796dd1a8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a5fb68-24')
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:aa,bridge_name='br-int',has_traffic_filtering=True,id=3621c1af-c3c1-4fa9-b948-1c0930d2157a,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3621c1af-c3') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:aa,bridge_name='br-int',has_traffic_filtering=True,id=3621c1af-c3c1-4fa9-b948-1c0930d2157a,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3621c1af-c3') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3621c1af-c3, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: INFO os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:aa,bridge_name='br-int',has_traffic_filtering=True,id=3621c1af-c3c1-4fa9-b948-1c0930d2157a,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3621c1af-c3')
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T13:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1605254584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1605254584',id=18,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSq6XQ4caufUvJwDWh/FHu8XOZxsjeOASPUhySjLEsc2eLlHEwdeIsvYkhQHX+yjegrJA1yy3rGe2AJtD7LZD1pwqG+bqlWA/1s1wox8kDswmUSHJEkOHpUTZNfVPt0ww==',key_name='tempest-keypair-921826627',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='316542161a3c466cabddb6eadf93087c',ramdisk_id='',reservation_id='r-t3oq4z9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1250659975',owner_user_name='tempest-TaggedBootDevicesTest-1250659975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90d1b91444c44871908744b33bf33772',uuid=5282ea2a-f5f3-423e-980c-d80a8b7405fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converting VIF {"id": "34242348-5fb7-4cf9-9d10-069ccec48e42", "address": "fa:16:3e:4f:46:a1", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34242348-5f", "ovs_interfaceid": "34242348-5fb7-4cf9-9d10-069ccec48e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:46:a1,bridge_name='br-int',has_traffic_filtering=True,id=34242348-5fb7-4cf9-9d10-069ccec48e42,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34242348-5f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:46:a1,bridge_name='br-int',has_traffic_filtering=True,id=34242348-5fb7-4cf9-9d10-069ccec48e42,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34242348-5f') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34242348-5f, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: INFO os_vif [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:46:a1,bridge_name='br-int',has_traffic_filtering=True,id=34242348-5fb7-4cf9-9d10-069ccec48e42,network=Network(12af9a81-c7d6-4f9f-a985-542e2e5cd44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34242348-5f')
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKRSWDQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:39:53 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67052d0-b829-45b4-ae44-9ea3b2e0c779]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:39:53 user nova-compute[70914]: No targets found.
Jul 27 13:39:53 user nova-compute[70914]: iSNS:
Jul 27 13:39:53 user nova-compute[70914]: No targets found.
Jul 27 13:39:53 user nova-compute[70914]: STATIC:
Jul 27 13:39:53 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c
Jul 27 13:39:53 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:53 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:53 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:39:53 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:53 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:53 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d
Jul 27 13:39:53 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:53 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:53 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d
Jul 27 13:39:53 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:53 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:53 user nova-compute[70914]: FIRMWARE:
Jul 27 13:39:53 user nova-compute[70914]: No targets found.
Jul 27 13:39:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:39:53 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:39:53 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddd270e-0cd4-4c62-b12c-4bc202849b7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d76848e-1ef2-4628-9591-8650a1041fe9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:39:53 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:39:53 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:53 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c (non-flash)
Jul 27 13:39:53 user nova-compute[70914]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:39:53 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:53 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18170310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c'): ({'sdc'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Removing single pathed devices sdc {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c59335-9d69-405d-a860-b72e3b97e950]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3983ca-a85e-4df7-bd4c-fa2c82455581]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Flushing IO for device /dev/sdc {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d396b1e9-aa29-44b2-bbd3-4c59702ae649]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fdfcc9-8709-44ee-8870-056fc008c0ef]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b5e748-7fde-4eb2-ab3b-c2888129dc22]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0830d380-9aef-41a5-9f3a-b726ce9eb593]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c, portal: 172.16.0.220,3260]
Jul 27 13:39:53 user nova-compute[70914]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c, portal: 172.16.0.220,3260] successful.
Jul 27 13:39:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c12f28-90f2-4f30-a359-ba3a1632533c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0e85f6-cc04-4841-83dd-cd8f759bcaf6]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] <== disconnect_volume: return (323ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WFVNYJbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:39:53 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c473144-635a-4fd9-abd9-f40c24c5bedc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:39:53 user nova-compute[70914]: No targets found.
Jul 27 13:39:53 user nova-compute[70914]: iSNS:
Jul 27 13:39:53 user nova-compute[70914]: No targets found.
Jul 27 13:39:53 user nova-compute[70914]: STATIC:
Jul 27 13:39:53 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:39:53 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:53 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:53 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d
Jul 27 13:39:53 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:53 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:53 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d
Jul 27 13:39:53 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:53 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:53 user nova-compute[70914]: FIRMWARE:
Jul 27 13:39:53 user nova-compute[70914]: No targets found.
Jul 27 13:39:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:39:53 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:39:53 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170cb20-dc50-4773-accc-1ff5015585df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3109ee29-ad50-4f65-9207-391d95a9f9fa]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:39:53 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:53 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d (non-flash)
Jul 27 13:39:53 user nova-compute[70914]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:53 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c3818aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d'): ({'sdd'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Removing single pathed devices sdd {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ddbcd-bfeb-42f4-a773-1f850c5ee169]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[755ce498-130c-406e-a00b-ecd3fd8cca0d]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Flushing IO for device /dev/sdd {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb776bc-2428-4a33-a58f-ed1f6ff20c89]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6b1f6e-7878-41dc-854c-8599085c6661]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf1764b-0d5d-4931-a5d9-50c9eacb2909]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a92555-132e-4de1-9866-cdee2ce148a5]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d, portal: 172.16.0.220,3260]
Jul 27 13:39:53 user nova-compute[70914]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d, portal: 172.16.0.220,3260] successful.
Jul 27 13:39:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdda580b-8b57-4531-99c1-282ed9b0465d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[654b7550-f005-4d03-b384-4e3281b59587]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] <== disconnect_volume: return (325ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJynkfbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:39:54 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cd7ad9-c31f-48a1-802d-8866bb5c590e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:39:54 user nova-compute[70914]: No targets found.
Jul 27 13:39:54 user nova-compute[70914]: iSNS:
Jul 27 13:39:54 user nova-compute[70914]: No targets found.
Jul 27 13:39:54 user nova-compute[70914]: STATIC:
Jul 27 13:39:54 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:39:54 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:54 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:54 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d
Jul 27 13:39:54 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:39:54 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:39:54 user nova-compute[70914]: FIRMWARE:
Jul 27 13:39:54 user nova-compute[70914]: No targets found.
Jul 27 13:39:54 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:39:54 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:39:54 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb9a91b-6512-4c42-aacf-bfcb4a9ed486]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f79037d-ea8d-4ec5-ba56-55c17fe44220]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:54 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:54 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d (non-flash)
Jul 27 13:39:54 user nova-compute[70914]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:39:54 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c3818aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d'): ({'sde'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Removing single pathed devices sde {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ad4f2c-1344-4f2f-ae7a-5c660ac711e3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-1e45760e-f920-47d7-855d-52c070373765 req-cc1e95b5-f23b-4b45-a012-60540ea61a10 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1e45760e-f920-47d7-855d-52c070373765 req-cc1e95b5-f23b-4b45-a012-60540ea61a10 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1e45760e-f920-47d7-855d-52c070373765 req-cc1e95b5-f23b-4b45-a012-60540ea61a10 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1e45760e-f920-47d7-855d-52c070373765 req-cc1e95b5-f23b-4b45-a012-60540ea61a10 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-1e45760e-f920-47d7-855d-52c070373765 req-cc1e95b5-f23b-4b45-a012-60540ea61a10 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:54 user nova-compute[70914]: WARNING nova.compute.manager [req-1e45760e-f920-47d7-855d-52c070373765 req-cc1e95b5-f23b-4b45-a012-60540ea61a10 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-3621c1af-c3c1-4fa9-b948-1c0930d2157a for instance with vm_state active and task_state deleting.
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a58efc-2e38-4724-b8a9-f7aa1d546ce9]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Flushing IO for device /dev/sde {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a929ea-2fed-4563-9e14-bc17c8b0b596]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[086a24e0-af70-4813-b511-34a312951f27]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9ecf10-cf42-47ee-a0fe-f306b96c24fa]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:54 user nova-compute[70914]: WARNING nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4 for instance with vm_state active and task_state deleting.
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-unplugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:54 user nova-compute[70914]: WARNING nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-4e8a50a8-25a0-46f7-b454-ca19f327b6b1 for instance with vm_state active and task_state deleting.
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-unplugged-07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-07a5fb68-24d1-40db-a367-696868645122 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:54 user nova-compute[70914]: WARNING nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-07a5fb68-24d1-40db-a367-696868645122 for instance with vm_state active and task_state deleting.
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-unplugged-34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-unplugged-34242348-5fb7-4cf9-9d10-069ccec48e42 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-plugged-34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Acquiring lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] No waiting events found dispatching network-vif-plugged-34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:39:54 user nova-compute[70914]: WARNING nova.compute.manager [req-6761a0d3-9a3e-4b59-be48-583271a719b1 req-bb15eaf7-ab95-4c00-94be-5253b6e75f47 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received unexpected event network-vif-plugged-34242348-5fb7-4cf9-9d10-069ccec48e42 for instance with vm_state active and task_state deleting.
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e27177-c8bb-4ff3-b4e7-5a93a73c08f6]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d, portal: 172.16.0.220,3260]
Jul 27 13:39:54 user nova-compute[70914]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d, portal: 172.16.0.220,3260] successful.
Jul 27 13:39:54 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:176decad-0adf-410c-830e-5bc4cc0ea19d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0906553-7c36-4ab5-8825-5a24964c5a45]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] <== disconnect_volume: return (296ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:39:54 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Deleting instance files /opt/stack/data/nova/instances/5282ea2a-f5f3-423e-980c-d80a8b7405fd_del
Jul 27 13:39:54 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Deletion of /opt/stack/data/nova/instances/5282ea2a-f5f3-423e-980c-d80a8b7405fd_del complete
Jul 27 13:39:54 user nova-compute[70914]: INFO nova.compute.manager [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Took 3.25 seconds to destroy the instance on the hypervisor.
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lazy-loading 'flavor' on Instance uuid 10fa8c48-a95a-411f-9de0-aabf19455f57 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:39:55 user nova-compute[70914]: INFO nova.compute.manager [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Attaching volume 9516af03-9ec4-47e2-ad03-ac4fa028ba51 to /dev/vdb
Jul 27 13:39:55 user nova-compute[70914]: DEBUG os_brick.utils [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6dd64f-ddef-444b-977f-5841792af38f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3651b0e1-6e76-46b8-8de5-88101a4b05b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c706709-23d8-43e7-9e55-5a2c01ebf1f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbd051d-49b9-4c48-9116-052862ee7145]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:39:55 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:39:55 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca23b36-9d2e-4db6-9978-f0f12a34cbd2]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG os_brick.utils [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:39:55 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Updating existing volume attachment record: ee4ea3a5-830c-4acf-8540-4cba496e0cd3 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:39:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-961a91aa-e9b0-4517-aa6e-2342e4b16df6 req-b9afd839-f70f-4925-a17c-00121c5520d7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-deleted-34242348-5fb7-4cf9-9d10-069ccec48e42 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:56 user nova-compute[70914]: INFO nova.compute.manager [req-961a91aa-e9b0-4517-aa6e-2342e4b16df6 req-b9afd839-f70f-4925-a17c-00121c5520d7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Neutron deleted interface 34242348-5fb7-4cf9-9d10-069ccec48e42; detaching it from the instance and deleting it from the info cache
Jul 27 13:39:56 user nova-compute[70914]: DEBUG nova.network.neutron [req-961a91aa-e9b0-4517-aa6e-2342e4b16df6 req-b9afd839-f70f-4925-a17c-00121c5520d7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [{"id": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "address": "fa:16:3e:a7:aa:13", "network": {"id": "07f3571f-9eb1-405a-b8f2-ad5713e12021", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-859311358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f538a9-8a", "ovs_interfaceid": "34f538a9-8a9c-47a8-8aae-5a96279d31d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "address": "fa:16:3e:c0:d7:bc", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6d11f3-e8", "ovs_interfaceid": "7b6d11f3-e8da-417a-95ed-d6dcaaa2f7c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "address": "fa:16:3e:68:4a:03", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8a50a8-25", "ovs_interfaceid": "4e8a50a8-25a0-46f7-b454-ca19f327b6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf2cbb47-3c62-4067-aed5-e1f597744523", "address": "fa:16:3e:16:bf:b4", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2cbb47-3c", "ovs_interfaceid": "cf2cbb47-3c62-4067-aed5-e1f597744523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a5fb68-24d1-40db-a367-696868645122", "address": "fa:16:3e:73:80:45", "network": {"id": "b4cb1eaf-b382-4942-982a-d7796dd1a8e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516763245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a5fb68-24", "ovs_interfaceid": "07a5fb68-24d1-40db-a367-696868645122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "address": "fa:16:3e:cc:f8:aa", "network": {"id": "12af9a81-c7d6-4f9f-a985-542e2e5cd44e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416896190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "316542161a3c466cabddb6eadf93087c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3621c1af-c3", "ovs_interfaceid": "3621c1af-c3c1-4fa9-b948-1c0930d2157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:39:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-961a91aa-e9b0-4517-aa6e-2342e4b16df6 req-b9afd839-f70f-4925-a17c-00121c5520d7 service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Detach interface failed, port_id=34242348-5fb7-4cf9-9d10-069ccec48e42, reason: Instance 5282ea2a-f5f3-423e-980c-d80a8b7405fd could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:39:57 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:39:57 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Took 3.49 seconds to deallocate network for instance.
Jul 27 13:39:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:39:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-73a83a9b-bfd5-4741-8bc8-a887c25cdb69 req-261267db-7b7c-41ed-84a5-fadb35a5952b service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-deleted-3621c1af-c3c1-4fa9-b948-1c0930d2157a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-73a83a9b-bfd5-4741-8bc8-a887c25cdb69 req-261267db-7b7c-41ed-84a5-fadb35a5952b service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-deleted-cf2cbb47-3c62-4067-aed5-e1f597744523 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-73a83a9b-bfd5-4741-8bc8-a887c25cdb69 req-261267db-7b7c-41ed-84a5-fadb35a5952b service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-deleted-34f538a9-8a9c-47a8-8aae-5a96279d31d5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-73a83a9b-bfd5-4741-8bc8-a887c25cdb69 req-261267db-7b7c-41ed-84a5-fadb35a5952b service nova] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Received event network-vif-deleted-07a5fb68-24d1-40db-a367-696868645122 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:39:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:00 user nova-compute[70914]: INFO nova.compute.manager [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Took 2.16 seconds to detach 3 volumes for instance.
Jul 27 13:40:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:00 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:40:00 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:40:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:00 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Deleted allocations for instance 5282ea2a-f5f3-423e-980c-d80a8b7405fd
Jul 27 13:40:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-25a4667f-2433-40b6-b774-4e0231feea03 tempest-TaggedBootDevicesTest-1250659975 tempest-TaggedBootDevicesTest-1250659975-project-member] Lock "5282ea2a-f5f3-423e-980c-d80a8b7405fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.423s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeSRVUdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:40:02 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:40:02 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:40:02 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e536912a-dd4e-4c73-bf93-2e0d03258ddc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:40:02 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30a14fc-fbab-48b1-b67a-8cb965111205]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51] added
Jul 27 13:40:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca170a0-4b48-4556-b0b5-acbcdc45a4b8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[034d923e-fe87-4b24-bbb5-970a8dbe79e7]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeSRVUdJ {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeSRVUdJ" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[69286ec7-e71d-4baf-8431-32266ab7c704]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QeSRVUdJ'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a1746f-0979-472c-ad0c-1fcab17a3534]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f41115-8982-468b-8033-13c300443d51]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:40:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --login" returned: 0 in 1.061s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cae8b4-6d01-422d-972c-7a26a73e72a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51, portal: 172.16.0.220,3260]
Jul 27 13:40:03 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51, portal: 172.16.0.220,3260] successful.
Jul 27 13:40:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.070s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3902b44-5927-43d2-85ca-7f84e869a525]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ff8ada-72e7-498e-9eb7-0ee5b873d0f0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:03 user nova-compute[70914]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 (non-flash)
Jul 27 13:40:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:03 user nova-compute[70914]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 (non-flash)
Jul 27 13:40:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.326s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f0516-9e19-488a-972e-e3d38dbd00d9]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:40:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeSRVUdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:40:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.358s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:40:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] <== connect_volume: return (2360ms) {'type': 'block', 'scsi_wwn': '26439393037393561', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:40:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439393037393561', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:40:04 user nova-compute[70914]: DEBUG nova.objects.instance [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lazy-loading 'flavor' on Instance uuid 10fa8c48-a95a-411f-9de0-aabf19455f57 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:40:04 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:40:04 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 13:40:04 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:40:04 user nova-compute[70914]:   <serial>9516af03-9ec4-47e2-ad03-ac4fa028ba51</serial>
Jul 27 13:40:04 user nova-compute[70914]: </disk>
Jul 27 13:40:04 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:40:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] No VIF found with MAC fa:16:3e:76:1d:3b, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:40:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-846c465a-5060-484a-80f8-aafe3e2ab835 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.859s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:06 user nova-compute[70914]: INFO nova.compute.manager [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Detaching volume 9516af03-9ec4-47e2-ad03-ac4fa028ba51
Jul 27 13:40:06 user nova-compute[70914]: INFO nova.virt.block_device [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Attempting to driver detach volume 9516af03-9ec4-47e2-ad03-ac4fa028ba51 from mountpoint /dev/vdb
Jul 27 13:40:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Attempting to detach device vdb from instance 10fa8c48-a95a-411f-9de0-aabf19455f57 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:40:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:40:06 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:40:06 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 13:40:06 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:40:06 user nova-compute[70914]:   <serial>9516af03-9ec4-47e2-ad03-ac4fa028ba51</serial>
Jul 27 13:40:06 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:40:06 user nova-compute[70914]: </disk>
Jul 27 13:40:06 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:40:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Successfully detached device vdb from instance 10fa8c48-a95a-411f-9de0-aabf19455f57 from the persistent domain config.
Jul 27 13:40:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 10fa8c48-a95a-411f-9de0-aabf19455f57 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:40:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:40:06 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:40:06 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 13:40:06 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:40:06 user nova-compute[70914]:   <serial>9516af03-9ec4-47e2-ad03-ac4fa028ba51</serial>
Jul 27 13:40:06 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:40:06 user nova-compute[70914]: </disk>
Jul 27 13:40:06 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465207.1332805, 10fa8c48-a95a-411f-9de0-aabf19455f57 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 10fa8c48-a95a-411f-9de0-aabf19455f57 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:40:07 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Successfully detached device vdb from instance 10fa8c48-a95a-411f-9de0-aabf19455f57 from the live domain config.
Jul 27 13:40:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeSRVUdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:40:07 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17eadb2-9eab-4d99-98a7-24101afe1372]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:40:07 user nova-compute[70914]: No targets found.
Jul 27 13:40:07 user nova-compute[70914]: iSNS:
Jul 27 13:40:07 user nova-compute[70914]: No targets found.
Jul 27 13:40:07 user nova-compute[70914]: STATIC:
Jul 27 13:40:07 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:40:07 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:40:07 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:40:07 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51
Jul 27 13:40:07 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:40:07 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:40:07 user nova-compute[70914]: FIRMWARE:
Jul 27 13:40:07 user nova-compute[70914]: No targets found.
Jul 27 13:40:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:40:07 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:40:07 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f539628c-8742-4d8e-9c66-050d1a750eeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6ac361-fc89-4fca-8afe-82440267e669]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:07 user nova-compute[70914]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 (non-flash)
Jul 27 13:40:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:07 user nova-compute[70914]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 (non-flash)
Jul 27 13:40:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c181de3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51'): ({'sdc'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Removing single pathed devices sdc {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[33da0bbb-1412-4d56-9a28-20cc6527c146]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b4208e-b9f5-4bfd-84e7-abfd194cb5e3]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Flushing IO for device /dev/sdc {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b96efd3-7f9d-437f-9816-fd4e9b4e2085]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde946ec-a70f-4c19-9ff8-8f395526fe85]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c9fbaf-c64a-4538-853d-7b6b3ccb85be]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[55663cb8-6b9c-4b05-9ca9-b6d96fadc693]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51, portal: 172.16.0.220,3260]
Jul 27 13:40:07 user nova-compute[70914]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51, portal: 172.16.0.220,3260] successful.
Jul 27 13:40:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9516af03-9ec4-47e2-ad03-ac4fa028ba51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed8e706-daf7-49bf-8445-a4607f8a4404]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] <== disconnect_volume: return (277ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:40:07 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465192.9513896, 5282ea2a-f5f3-423e-980c-d80a8b7405fd => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:40:07 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] VM Stopped (Lifecycle Event)
Jul 27 13:40:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7bf18536-5517-4497-8a3c-5d5824004211 None None] [instance: 5282ea2a-f5f3-423e-980c-d80a8b7405fd] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:08 user nova-compute[70914]: DEBUG nova.objects.instance [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lazy-loading 'flavor' on Instance uuid 10fa8c48-a95a-411f-9de0-aabf19455f57 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b2875292-5dd5-4c92-93f1-00eae290218a tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.617s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:40:12 user nova-compute[70914]: INFO nova.compute.claims [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Claim successful on node user
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:40:12 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.policy [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89bc44e787074838ba46afd3f81262f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9647080d1194d60aeb390b127895474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:40:12 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Creating image(s)
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "/opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "/opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.objects.instance [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquired lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.network.neutron [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG nova.objects.instance [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'info_cache' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk 1073741824" returned: 0 in 0.066s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Successfully created port: 90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Cannot resize image /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG nova.objects.instance [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'migration_context' on Instance uuid 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Ensure instance console log exists: /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Successfully updated port: 90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquired lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-2d23cd3c-db32-4363-bd21-1a65b4f67f41 req-ccefd308-c77b-49cf-b820-b4d699bbd2e7 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Received event network-changed-90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-2d23cd3c-db32-4363-bd21-1a65b4f67f41 req-ccefd308-c77b-49cf-b820-b4d699bbd2e7 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Refreshing instance network info cache due to event network-changed-90afa138-9668-43f0-8c38-3789741da9da. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2d23cd3c-db32-4363-bd21-1a65b4f67f41 req-ccefd308-c77b-49cf-b820-b4d699bbd2e7 service nova] Acquiring lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updating instance_info_cache with network_info: [{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Releasing lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:40:14 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance destroyed successfully.
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.objects.instance [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'resources' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1253144734',display_name='tempest-AttachVolumeTestJSON-server-1253144734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1253144734',id=6,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATTI1RFyfQ2PRv5NB5cEM2tkF6yPM7cRAOJeCVPdJukiYvV0GqTPHVKc2LLrkmUe7gAf9AX0WCEnPmbS46UKi6r5ob0VnyeUfGZfj+EtT1Nf6CADr6H3u6d7f2/M6ZW3A==',key_name='tempest-keypair-1952109515',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-k0nq37r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG os_vif [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e9e022a-7a, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:14 user nova-compute[70914]: INFO os_vif [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a')
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Start _get_guest_xml network_info=[{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.objects.instance [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'numa_topology' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:14 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:40:14 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.objects.instance [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1253144734',display_name='tempest-AttachVolumeTestJSON-server-1253144734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1253144734',id=6,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATTI1RFyfQ2PRv5NB5cEM2tkF6yPM7cRAOJeCVPdJukiYvV0GqTPHVKc2LLrkmUe7gAf9AX0WCEnPmbS46UKi6r5ob0VnyeUfGZfj+EtT1Nf6CADr6H3u6d7f2/M6ZW3A==',key_name='tempest-keypair-1952109515',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-k0nq37r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.objects.instance [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'pci_devices' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:40:14 user nova-compute[70914]:   <uuid>bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5</uuid>
Jul 27 13:40:14 user nova-compute[70914]:   <name>instance-00000006</name>
Jul 27 13:40:14 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:40:14 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:40:14 user nova-compute[70914]:   <metadata>
Jul 27 13:40:14 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:40:14 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeTestJSON-server-1253144734</nova:name>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:40:14</nova:creationTime>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:40:14 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:40:14 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:owner>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:user uuid="7e9e3e0bd86140ada9edb906a16e4784">tempest-AttachVolumeTestJSON-366868791-project-member</nova:user>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:project uuid="b0b9d12319d046088ca51fc23be9bb21">tempest-AttachVolumeTestJSON-366868791</nova:project>
Jul 27 13:40:14 user nova-compute[70914]:       </nova:owner>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:ports>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:port uuid="3e9e022a-7a8b-42ed-b88f-2c32b880ee78">
Jul 27 13:40:14 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 13:40:14 user nova-compute[70914]:         </nova:port>
Jul 27 13:40:14 user nova-compute[70914]:       </nova:ports>
Jul 27 13:40:14 user nova-compute[70914]:     </nova:instance>
Jul 27 13:40:14 user nova-compute[70914]:   </metadata>
Jul 27 13:40:14 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:40:14 user nova-compute[70914]:     <system>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="serial">bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5</entry>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="uuid">bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5</entry>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:40:14 user nova-compute[70914]:     </system>
Jul 27 13:40:14 user nova-compute[70914]:   </sysinfo>
Jul 27 13:40:14 user nova-compute[70914]:   <os>
Jul 27 13:40:14 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:40:14 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:40:14 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:40:14 user nova-compute[70914]:   </os>
Jul 27 13:40:14 user nova-compute[70914]:   <features>
Jul 27 13:40:14 user nova-compute[70914]:     <acpi/>
Jul 27 13:40:14 user nova-compute[70914]:     <apic/>
Jul 27 13:40:14 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:40:14 user nova-compute[70914]:   </features>
Jul 27 13:40:14 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:40:14 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:40:14 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:40:14 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:40:14 user nova-compute[70914]:   </clock>
Jul 27 13:40:14 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:40:14 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:40:14 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:40:14 user nova-compute[70914]:   </cpu>
Jul 27 13:40:14 user nova-compute[70914]:   <devices>
Jul 27 13:40:14 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:40:14 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:40:14 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk"/>
Jul 27 13:40:14 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:40:14 user nova-compute[70914]:     </disk>
Jul 27 13:40:14 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:40:14 user nova-compute[70914]:       <mac address="fa:16:3e:a7:0c:e4"/>
Jul 27 13:40:14 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:40:14 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:40:14 user nova-compute[70914]:       <target dev="tap3e9e022a-7a"/>
Jul 27 13:40:14 user nova-compute[70914]:     </interface>
Jul 27 13:40:14 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:40:14 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/console.log" append="off"/>
Jul 27 13:40:14 user nova-compute[70914]:     </serial>
Jul 27 13:40:14 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:40:14 user nova-compute[70914]:     <video>
Jul 27 13:40:14 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:40:14 user nova-compute[70914]:     </video>
Jul 27 13:40:14 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:40:14 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:40:14 user nova-compute[70914]:     </rng>
Jul 27 13:40:14 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:40:14 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:40:14 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:40:14 user nova-compute[70914]:     </memballoon>
Jul 27 13:40:14 user nova-compute[70914]:   </devices>
Jul 27 13:40:14 user nova-compute[70914]: </domain>
Jul 27 13:40:14 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Updating instance_info_cache with network_info: [{"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Releasing lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Instance network_info: |[{"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2d23cd3c-db32-4363-bd21-1a65b4f67f41 req-ccefd308-c77b-49cf-b820-b4d699bbd2e7 service nova] Acquired lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.neutron [req-2d23cd3c-db32-4363-bd21-1a65b4f67f41 req-ccefd308-c77b-49cf-b820-b4d699bbd2e7 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Refreshing network info cache for port 90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Start _get_guest_xml network_info=[{"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:40:14 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:40:14 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-211190651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-211190651',id=20,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-7gk2hxpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:40:13Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=8a2674b5-adaf-4195-bbce-9d48fa1fa4e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:61,bridge_name='br-int',has_traffic_filtering=True,id=90afa138-9668-43f0-8c38-3789741da9da,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90afa138-96') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.objects.instance [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:40:14 user nova-compute[70914]:   <uuid>8a2674b5-adaf-4195-bbce-9d48fa1fa4e6</uuid>
Jul 27 13:40:14 user nova-compute[70914]:   <name>instance-00000014</name>
Jul 27 13:40:14 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:40:14 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:40:14 user nova-compute[70914]:   <metadata>
Jul 27 13:40:14 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:40:14 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-211190651</nova:name>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:40:14</nova:creationTime>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:40:14 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:40:14 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:owner>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:user uuid="89bc44e787074838ba46afd3f81262f0">tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member</nova:user>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:project uuid="e9647080d1194d60aeb390b127895474">tempest-ServerBootFromVolumeStableRescueTest-853279030</nova:project>
Jul 27 13:40:14 user nova-compute[70914]:       </nova:owner>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:40:14 user nova-compute[70914]:       <nova:ports>
Jul 27 13:40:14 user nova-compute[70914]:         <nova:port uuid="90afa138-9668-43f0-8c38-3789741da9da">
Jul 27 13:40:14 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 13:40:14 user nova-compute[70914]:         </nova:port>
Jul 27 13:40:14 user nova-compute[70914]:       </nova:ports>
Jul 27 13:40:14 user nova-compute[70914]:     </nova:instance>
Jul 27 13:40:14 user nova-compute[70914]:   </metadata>
Jul 27 13:40:14 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:40:14 user nova-compute[70914]:     <system>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="serial">8a2674b5-adaf-4195-bbce-9d48fa1fa4e6</entry>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="uuid">8a2674b5-adaf-4195-bbce-9d48fa1fa4e6</entry>
Jul 27 13:40:14 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:40:14 user nova-compute[70914]:     </system>
Jul 27 13:40:14 user nova-compute[70914]:   </sysinfo>
Jul 27 13:40:14 user nova-compute[70914]:   <os>
Jul 27 13:40:14 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:40:14 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:40:14 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:40:14 user nova-compute[70914]:   </os>
Jul 27 13:40:14 user nova-compute[70914]:   <features>
Jul 27 13:40:14 user nova-compute[70914]:     <acpi/>
Jul 27 13:40:14 user nova-compute[70914]:     <apic/>
Jul 27 13:40:14 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:40:14 user nova-compute[70914]:   </features>
Jul 27 13:40:14 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:40:14 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:40:14 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:40:14 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:40:14 user nova-compute[70914]:   </clock>
Jul 27 13:40:14 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:40:14 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:40:14 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:40:14 user nova-compute[70914]:   </cpu>
Jul 27 13:40:14 user nova-compute[70914]:   <devices>
Jul 27 13:40:14 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:40:14 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:40:14 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk"/>
Jul 27 13:40:14 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:40:14 user nova-compute[70914]:     </disk>
Jul 27 13:40:14 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:40:14 user nova-compute[70914]:       <mac address="fa:16:3e:44:40:61"/>
Jul 27 13:40:14 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:40:14 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:40:14 user nova-compute[70914]:       <target dev="tap90afa138-96"/>
Jul 27 13:40:14 user nova-compute[70914]:     </interface>
Jul 27 13:40:14 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:40:14 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/console.log" append="off"/>
Jul 27 13:40:14 user nova-compute[70914]:     </serial>
Jul 27 13:40:14 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:40:14 user nova-compute[70914]:     <video>
Jul 27 13:40:14 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:40:14 user nova-compute[70914]:     </video>
Jul 27 13:40:14 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:40:14 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:40:14 user nova-compute[70914]:     </rng>
Jul 27 13:40:14 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:40:14 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:40:14 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:40:14 user nova-compute[70914]:     </memballoon>
Jul 27 13:40:14 user nova-compute[70914]:   </devices>
Jul 27 13:40:14 user nova-compute[70914]: </domain>
Jul 27 13:40:14 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-211190651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-211190651',id=20,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-7gk2hxpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:40:13Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=8a2674b5-adaf-4195-bbce-9d48fa1fa4e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:61,bridge_name='br-int',has_traffic_filtering=True,id=90afa138-9668-43f0-8c38-3789741da9da,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90afa138-96') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG os_vif [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:61,bridge_name='br-int',has_traffic_filtering=True,id=90afa138-9668-43f0-8c38-3789741da9da,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90afa138-96') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90afa138-96, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90afa138-96, col_values=(('external_ids', {'iface-id': '90afa138-9668-43f0-8c38-3789741da9da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:40:61', 'vm-uuid': '8a2674b5-adaf-4195-bbce-9d48fa1fa4e6'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:14 user nova-compute[70914]: INFO os_vif [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:61,bridge_name='br-int',has_traffic_filtering=True,id=90afa138-9668-43f0-8c38-3789741da9da,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90afa138-96')
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.objects.instance [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'trusted_certs' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No VIF found with MAC fa:16:3e:44:40:61, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG nova.network.neutron [req-2d23cd3c-db32-4363-bd21-1a65b4f67f41 req-ccefd308-c77b-49cf-b820-b4d699bbd2e7 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Updated VIF entry in instance network info cache for port 90afa138-9668-43f0-8c38-3789741da9da. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG nova.network.neutron [req-2d23cd3c-db32-4363-bd21-1a65b4f67f41 req-ccefd308-c77b-49cf-b820-b4d699bbd2e7 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Updating instance_info_cache with network_info: [{"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Cannot resize image /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG nova.objects.instance [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'migration_context' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2d23cd3c-db32-4363-bd21-1a65b4f67f41 req-ccefd308-c77b-49cf-b820-b4d699bbd2e7 service nova] Releasing lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1253144734',display_name='tempest-AttachVolumeTestJSON-server-1253144734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1253144734',id=6,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATTI1RFyfQ2PRv5NB5cEM2tkF6yPM7cRAOJeCVPdJukiYvV0GqTPHVKc2LLrkmUe7gAf9AX0WCEnPmbS46UKi6r5ob0VnyeUfGZfj+EtT1Nf6CADr6H3u6d7f2/M6ZW3A==',key_name='tempest-keypair-1952109515',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-k0nq37r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG os_vif [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e9e022a-7a, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e9e022a-7a, col_values=(('external_ids', {'iface-id': '3e9e022a-7a8b-42ed-b88f-2c32b880ee78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:0c:e4', 'vm-uuid': 'bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:40:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:15 user nova-compute[70914]: INFO os_vif [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a')
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG nova.objects.instance [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'flavor' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:16 user nova-compute[70914]: INFO nova.compute.manager [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Attaching volume c36b85f7-f21b-40fb-a7f8-34d88db9b4ba to /dev/vdb
Jul 27 13:40:16 user nova-compute[70914]: DEBUG os_brick.utils [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2382c439-f576-4a28-91dc-155b12ce8405]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2170625e-4a50-4ff2-b190-a4affd587d80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d10ff98-daa9-44b9-96e5-7479194ca3c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02ea6db-c337-4f62-a735-cdf81d63985f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:40:16 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:40:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[810b38d7-55f5-44f3-8991-b8b48ea03c61]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG os_brick.utils [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:40:16 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating existing volume attachment record: 316038b4-4489-49f5-8eee-c395da1ab77b {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-5d254810-ea6a-44db-a334-f18f85a6bd10 req-b7efba28-2451-4a89-aa05-c36d883ff118 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Received event network-vif-plugged-90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5d254810-ea6a-44db-a334-f18f85a6bd10 req-b7efba28-2451-4a89-aa05-c36d883ff118 service nova] Acquiring lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5d254810-ea6a-44db-a334-f18f85a6bd10 req-b7efba28-2451-4a89-aa05-c36d883ff118 service nova] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5d254810-ea6a-44db-a334-f18f85a6bd10 req-b7efba28-2451-4a89-aa05-c36d883ff118 service nova] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-5d254810-ea6a-44db-a334-f18f85a6bd10 req-b7efba28-2451-4a89-aa05-c36d883ff118 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] No waiting events found dispatching network-vif-plugged-90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:40:17 user nova-compute[70914]: WARNING nova.compute.manager [req-5d254810-ea6a-44db-a334-f18f85a6bd10 req-b7efba28-2451-4a89-aa05-c36d883ff118 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Received unexpected event network-vif-plugged-90afa138-9668-43f0-8c38-3789741da9da for instance with vm_state building and task_state spawning.
Jul 27 13:40:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-7dc95be8-ac0a-49d8-b345-3afbaaf8daa2 req-f9f9c547-f77c-46e3-b36c-e0f7b16cc0e3 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7dc95be8-ac0a-49d8-b345-3afbaaf8daa2 req-f9f9c547-f77c-46e3-b36c-e0f7b16cc0e3 service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7dc95be8-ac0a-49d8-b345-3afbaaf8daa2 req-f9f9c547-f77c-46e3-b36c-e0f7b16cc0e3 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7dc95be8-ac0a-49d8-b345-3afbaaf8daa2 req-f9f9c547-f77c-46e3-b36c-e0f7b16cc0e3 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-7dc95be8-ac0a-49d8-b345-3afbaaf8daa2 req-f9f9c547-f77c-46e3-b36c-e0f7b16cc0e3 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:40:17 user nova-compute[70914]: WARNING nova.compute.manager [req-7dc95be8-ac0a-49d8-b345-3afbaaf8daa2 req-f9f9c547-f77c-46e3-b36c-e0f7b16cc0e3 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state stopped and task_state powering-on.
Jul 27 13:40:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-211f9453-29c8-4a5b-b9aa-72ea9ed9a4a9 req-5063c05a-f9b1-4cf6-a14f-ec6854a5aeb8 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Received event network-vif-plugged-90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-211f9453-29c8-4a5b-b9aa-72ea9ed9a4a9 req-5063c05a-f9b1-4cf6-a14f-ec6854a5aeb8 service nova] Acquiring lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-211f9453-29c8-4a5b-b9aa-72ea9ed9a4a9 req-5063c05a-f9b1-4cf6-a14f-ec6854a5aeb8 service nova] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-211f9453-29c8-4a5b-b9aa-72ea9ed9a4a9 req-5063c05a-f9b1-4cf6-a14f-ec6854a5aeb8 service nova] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-211f9453-29c8-4a5b-b9aa-72ea9ed9a4a9 req-5063c05a-f9b1-4cf6-a14f-ec6854a5aeb8 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] No waiting events found dispatching network-vif-plugged-90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:40:19 user nova-compute[70914]: WARNING nova.compute.manager [req-211f9453-29c8-4a5b-b9aa-72ea9ed9a4a9 req-5063c05a-f9b1-4cf6-a14f-ec6854a5aeb8 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Received unexpected event network-vif-plugged-90afa138-9668-43f0-8c38-3789741da9da for instance with vm_state building and task_state spawning.
Jul 27 13:40:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-a1f2c8a6-15ed-4fed-99b2-d87af9eae454 req-f4c732ec-aeb0-4ad5-bce4-c5ce967aee45 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a1f2c8a6-15ed-4fed-99b2-d87af9eae454 req-f4c732ec-aeb0-4ad5-bce4-c5ce967aee45 service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a1f2c8a6-15ed-4fed-99b2-d87af9eae454 req-f4c732ec-aeb0-4ad5-bce4-c5ce967aee45 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a1f2c8a6-15ed-4fed-99b2-d87af9eae454 req-f4c732ec-aeb0-4ad5-bce4-c5ce967aee45 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-a1f2c8a6-15ed-4fed-99b2-d87af9eae454 req-f4c732ec-aeb0-4ad5-bce4-c5ce967aee45 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:40:19 user nova-compute[70914]: WARNING nova.compute.manager [req-a1f2c8a6-15ed-4fed-99b2-d87af9eae454 req-f4c732ec-aeb0-4ad5-bce4-c5ce967aee45 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state stopped and task_state powering-on.
Jul 27 13:40:19 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465219.9744487, 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:40:19 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] VM Resumed (Lifecycle Event)
Jul 27 13:40:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:40:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:40:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Instance spawned successfully.
Jul 27 13:40:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:20 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465219.9801807, 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:40:20 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] VM Started (Lifecycle Event)
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:40:20 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance rebooted successfully.
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-41e05758-9391-4057-b6c4-a28a058e3391 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:20 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465220.100965, bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:40:20 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] VM Resumed (Lifecycle Event)
Jul 27 13:40:20 user nova-compute[70914]: INFO nova.compute.manager [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Took 7.30 seconds to spawn the instance on the hypervisor.
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465220.1072633, bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:40:20 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] VM Started (Lifecycle Event)
Jul 27 13:40:20 user nova-compute[70914]: INFO nova.compute.manager [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Took 8.07 seconds to build instance.
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:40:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e7bfbbbb-7a04-4582-a34b-9551416dd3dc tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.168s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKJPxEus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:40:23 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:40:23 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:40:23 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1fc3f2-3858-438c-a78d-763dd1d67925]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:40:23 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8db1a8b-2ff5-4950-80a8-d77ae6e787bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba] added
Jul 27 13:40:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaefec5-cd18-4cd1-9bcf-b1f05d896cc8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9884174-b510-46ae-bdbe-d2fc2dfe2d53]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKJPxEus {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKJPxEus" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ca3b4b-92a5-4b9c-a0b3-ed698bf3bf2f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GKJPxEus'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[662111b8-9377-4424-9b11-4f3dce133316]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d186c9-d06f-484f-a4c6-b1381e9d7221]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eff6734-7340-4b3a-aa21-1507615302df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba, portal: 172.16.0.220,3260]
Jul 27 13:40:23 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba, portal: 172.16.0.220,3260] successful.
Jul 27 13:40:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[effecd4f-70d9-4347-8024-9879bf4d9ff6]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f96d7e-1f8f-40c4-a692-a8e1b43c5ef1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:23 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:40:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:23 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:40:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[448b938a-2a9f-462b-88e7-f921ba42c32c]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:40:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKJPxEus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:40:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:40:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23464653539376338', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:40:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464653539376338', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:40:24 user nova-compute[70914]: DEBUG nova.objects.instance [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'flavor' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:40:24 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:40:24 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 13:40:24 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:40:24 user nova-compute[70914]:   <serial>c36b85f7-f21b-40fb-a7f8-34d88db9b4ba</serial>
Jul 27 13:40:24 user nova-compute[70914]: </disk>
Jul 27 13:40:24 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:40:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] No VIF found with MAC fa:16:3e:8b:f4:cc, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:40:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2f834b1c-d4a7-4142-9339-10e0fb1e3ef5 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.235s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:26 user nova-compute[70914]: INFO nova.compute.manager [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Rescuing
Jul 27 13:40:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:40:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquired lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:40:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:40:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating instance_info_cache with network_info: [{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:40:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Releasing lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG nova.compute.manager [req-998009c8-1dee-4a4b-af3c-7f4cae391d7b req-5abef53c-b9bb-4f64-b298-88796e2ce3d7 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-unplugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-998009c8-1dee-4a4b-af3c-7f4cae391d7b req-5abef53c-b9bb-4f64-b298-88796e2ce3d7 service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-998009c8-1dee-4a4b-af3c-7f4cae391d7b req-5abef53c-b9bb-4f64-b298-88796e2ce3d7 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-998009c8-1dee-4a4b-af3c-7f4cae391d7b req-5abef53c-b9bb-4f64-b298-88796e2ce3d7 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG nova.compute.manager [req-998009c8-1dee-4a4b-af3c-7f4cae391d7b req-5abef53c-b9bb-4f64-b298-88796e2ce3d7 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-unplugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:40:27 user nova-compute[70914]: WARNING nova.compute.manager [req-998009c8-1dee-4a4b-af3c-7f4cae391d7b req-5abef53c-b9bb-4f64-b298-88796e2ce3d7 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-unplugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state active and task_state rescuing.
Jul 27 13:40:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Instance destroyed successfully.
Jul 27 13:40:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Attempting a stable device rescue
Jul 27 13:40:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70914) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Instance directory exists: not creating {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 13:40:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Creating image(s)
Jul 27 13:40:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG nova.objects.instance [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'trusted_certs' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "a3e4849430f9572bb3abfc5ce4944d727edcf406" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "a3e4849430f9572bb3abfc5ce4944d727edcf406" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406.part --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406.part --force-share --output=json" returned: 0 in 0.169s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG nova.virt.images [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] cab86848-dd93-4174-94d5-a076a1d2de90 was qcow2, converting to raw {{(pid=70914) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406.part /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406.converted {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-f9ece5d5-fb75-4566-b785-18969e5e89be req-7b8e7897-3a5d-4ee9-9a1f-577bf4e6ad02 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f9ece5d5-fb75-4566-b785-18969e5e89be req-7b8e7897-3a5d-4ee9-9a1f-577bf4e6ad02 service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f9ece5d5-fb75-4566-b785-18969e5e89be req-7b8e7897-3a5d-4ee9-9a1f-577bf4e6ad02 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f9ece5d5-fb75-4566-b785-18969e5e89be req-7b8e7897-3a5d-4ee9-9a1f-577bf4e6ad02 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-f9ece5d5-fb75-4566-b785-18969e5e89be req-7b8e7897-3a5d-4ee9-9a1f-577bf4e6ad02 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:40:29 user nova-compute[70914]: WARNING nova.compute.manager [req-f9ece5d5-fb75-4566-b785-18969e5e89be req-7b8e7897-3a5d-4ee9-9a1f-577bf4e6ad02 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state active and task_state rescuing.
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406.part /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406.converted" returned: 0 in 0.503s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406.converted --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "a3e4849430f9572bb3abfc5ce4944d727edcf406" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.911s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "a3e4849430f9572bb3abfc5ce4944d727edcf406" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "a3e4849430f9572bb3abfc5ce4944d727edcf406" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406 --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406,backing_fmt=raw /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406,backing_fmt=raw /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue" returned: 0 in 0.050s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "a3e4849430f9572bb3abfc5ce4944d727edcf406" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'migration_context' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Start _get_guest_xml network_info=[{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "vif_mac": "fa:16:3e:8b:f4:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cab86848-dd93-4174-94d5-a076a1d2de90', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '316038b4-4489-49f5-8eee-c395da1ab77b', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKJPxEus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '509e7547-8472-4954-8fc6-a152e9667437', 'attached_at': '', 'detached_at': '', 'volume_id': 'c36b85f7-f21b-40fb-a7f8-34d88db9b4ba', 'serial': 'c36b85f7-f21b-40fb-a7f8-34d88db9b4ba'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'resources' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'numa_topology' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:30 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:40:30 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'vcpu_model' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKJPxEus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:40:30 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:40:30 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:40:30 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f695911-3087-4037-b22e-72e0b24ceff1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GKJPxEus\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 13:40:30 user nova-compute[70914]: node.name = iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba
Jul 27 13:40:30 user nova-compute[70914]: node.tpgt = -1
Jul 27 13:40:30 user nova-compute[70914]: node.startup = automatic
Jul 27 13:40:30 user nova-compute[70914]: node.leading_login = No
Jul 27 13:40:30 user nova-compute[70914]: iface.iscsi_ifacename = default
Jul 27 13:40:30 user nova-compute[70914]: iface.net_ifacename = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.ipaddress = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.prefix_len = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.hwaddress = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.transport_name = tcp
Jul 27 13:40:30 user nova-compute[70914]: iface.initiatorname = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.state = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.vlan_id = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.vlan_priority = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.vlan_state = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.iface_num = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.mtu = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.port = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.bootproto = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.subnet_mask = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.gateway = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.dhcp_alt_client_id = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.dhcp_dns = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.dhcp_learn_iqn = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.dhcp_vendor_id_state = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.dhcp_vendor_id = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.dhcp_slp_da = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.fragmentation = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.gratuitous_arp = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.incoming_forwarding = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.tos_state = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.tos = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.ttl = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.delayed_ack = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.tcp_nagle = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.tcp_wsf_state = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.tcp_wsf = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.tcp_timer_scale = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.tcp_timestamp = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.redirect = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.def_task_mgmt_timeout = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.header_digest = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.data_digest = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.immediate_data = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.initial_r2t = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.data_seq_inorder = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.data_pdu_inorder = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.erl = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.max_receive_data_len = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.first_burst_len = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.max_outstanding_r2t = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.max_burst_len = 0
Jul 27 13:40:30 user nova-compute[70914]: iface.chap_auth = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.bidi_chap = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.strict_login_compliance = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.discovery_auth = <empty>
Jul 27 13:40:30 user nova-compute[70914]: iface.discovery_logout = <empty>
Jul 27 13:40:30 user nova-compute[70914]: node.discovery_address = <empty>
Jul 27 13:40:30 user nova-compute[70914]: node.discovery_port = 0
Jul 27 13:40:30 user nova-compute[70914]: node.discovery_type = static
Jul 27 13:40:30 user nova-compute[70914]: node.session.initial_cmdsn = 0
Jul 27 13:40:30 user nova-compute[70914]: node.session.initial_login_retry_max = 8
Jul 27 13:40:30 user nova-compute[70914]: node.session.xmit_thread_priority = -20
Jul 27 13:40:30 user nova-compute[70914]: node.session.cmds_max = 128
Jul 27 13:40:30 user nova-compute[70914]: node.session.queue_depth = 32
Jul 27 13:40:30 user nova-compute[70914]: node.session.nr_sessions = 1
Jul 27 13:40:30 user nova-compute[70914]: node.session.auth.authmethod = CHAP
Jul 27 13:40:30 user nova-compute[70914]: node.session.auth.username = GKJPxEus
Jul 27 13:40:30 user nova-compute[70914]: node.session.auth.password = ***
Jul 27 13:40:30 user nova-compute[70914]: node.session.auth.username_in = <empty>
Jul 27 13:40:30 user nova-compute[70914]: node.session.auth.password_in = <empty>
Jul 27 13:40:30 user nova-compute[70914]: node.session.auth.chap_algs = MD5
Jul 27 13:40:30 user nova-compute[70914]: node.session.timeo.replacement_timeout = 120
Jul 27 13:40:30 user nova-compute[70914]: node.session.err_timeo.abort_timeout = 15
Jul 27 13:40:30 user nova-compute[70914]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 13:40:30 user nova-compute[70914]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 13:40:30 user nova-compute[70914]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 13:40:30 user nova-compute[70914]: node.session.iscsi.FastAbort = Yes
Jul 27 13:40:30 user nova-compute[70914]: node.session.iscsi.InitialR2T = No
Jul 27 13:40:30 user nova-compute[70914]: node.session.iscsi.ImmediateData = Yes
Jul 27 13:40:30 user nova-compute[70914]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 13:40:30 user nova-compute[70914]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 13:40:30 user nova-compute[70914]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 13:40:30 user nova-compute[70914]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 13:40:30 user nova-compute[70914]: node.session.iscsi.MaxConnections = 1
Jul 27 13:40:30 user nova-compute[70914]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 13:40:30 user nova-compute[70914]: node.session.iscsi.ERL = 0
Jul 27 13:40:30 user nova-compute[70914]: node.session.scan = manual
Jul 27 13:40:30 user nova-compute[70914]: node.session.reopen_max = 0
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].address = 172.16.0.220
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].port = 3260
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].startup = manual
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].tcp.window_size = 524288
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].tcp.type_of_service = 0
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].timeo.logout_timeout = 15
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].timeo.login_timeout = 15
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].timeo.auth_timeout = 45
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].iscsi.DataDigest = None
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].iscsi.IFMarker = No
Jul 27 13:40:30 user nova-compute[70914]: node.conn[0].iscsi.OFMarker = No
Jul 27 13:40:30 user nova-compute[70914]: # END RECORD
Jul 27 13:40:30 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9d6ce0-43af-4fca-aa9f-214ba260d98b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7af662-1699-43fc-b2d5-eb155f8debb0]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKJPxEus {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKJPxEus" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[09acfd5a-f916-4672-b5c1-d77d3df9ce3c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GKJPxEus'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b2e3b0-146e-408c-b170-d8f72a368fe9]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65c4d97-215e-4cdb-b347-f722e02db2bb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:30 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:40:30 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:30 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:40:30 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] HCTL ('34', '0', '0', 0) found on session 26 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4859aa-fe90-4378-a36f-b1fbfc561cb3]: (4, ('0 0 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Searching for a device in session 26 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKJPxEus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.170s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] <== connect_volume: return (171ms) {'type': 'block', 'scsi_wwn': '23464653539376338', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464653539376338', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1913153645',display_name='tempest-ServerStableDeviceRescueTest-server-1913153645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1913153645',id=16,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZtuqdDZDWOo97xKSb50o/8caWeMVr1tpEgfVE3erZUrnk/Hj4h9xffFcTwfYQRu4cXbjx+cdPga1/B+bf3ZwFDBubo5FIMGXYw908pwMqhui2gKJnbtIQfYUegpcdxfw==',key_name='tempest-keypair-1364291766',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03eaeefb7bc34913b18c81eb68c2e053',ramdisk_id='',reservation_id='r-z8urou9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-11916342',owner_user_name='tempest-ServerStableDeviceRescueTest-11916342-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='461c5809f98c42daa7520c1bd0477ffd',uuid=509e7547-8472-4954-8fc6-a152e9667437,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "vif_mac": "fa:16:3e:8b:f4:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Converting VIF {"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "vif_mac": "fa:16:3e:8b:f4:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f4:cc,bridge_name='br-int',has_traffic_filtering=True,id=7c115254-d063-49fe-b94c-e7a22b8ccb31,network=Network(ca534528-e241-4a4c-9ee7-30b7a67170e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c115254-d0') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'pci_devices' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:40:30 user nova-compute[70914]:   <uuid>509e7547-8472-4954-8fc6-a152e9667437</uuid>
Jul 27 13:40:30 user nova-compute[70914]:   <name>instance-00000010</name>
Jul 27 13:40:30 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:40:30 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:40:30 user nova-compute[70914]:   <metadata>
Jul 27 13:40:30 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:40:30 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:40:30 user nova-compute[70914]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1913153645</nova:name>
Jul 27 13:40:30 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:40:30</nova:creationTime>
Jul 27 13:40:30 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:40:30 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:40:30 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:40:30 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:40:30 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:40:30 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:40:30 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:40:30 user nova-compute[70914]:       <nova:owner>
Jul 27 13:40:30 user nova-compute[70914]:         <nova:user uuid="461c5809f98c42daa7520c1bd0477ffd">tempest-ServerStableDeviceRescueTest-11916342-project-member</nova:user>
Jul 27 13:40:30 user nova-compute[70914]:         <nova:project uuid="03eaeefb7bc34913b18c81eb68c2e053">tempest-ServerStableDeviceRescueTest-11916342</nova:project>
Jul 27 13:40:30 user nova-compute[70914]:       </nova:owner>
Jul 27 13:40:30 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:40:30 user nova-compute[70914]:       <nova:ports>
Jul 27 13:40:30 user nova-compute[70914]:         <nova:port uuid="7c115254-d063-49fe-b94c-e7a22b8ccb31">
Jul 27 13:40:30 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 13:40:30 user nova-compute[70914]:         </nova:port>
Jul 27 13:40:30 user nova-compute[70914]:       </nova:ports>
Jul 27 13:40:30 user nova-compute[70914]:     </nova:instance>
Jul 27 13:40:30 user nova-compute[70914]:   </metadata>
Jul 27 13:40:30 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:40:30 user nova-compute[70914]:     <system>
Jul 27 13:40:30 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:40:30 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:40:30 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:40:30 user nova-compute[70914]:       <entry name="serial">509e7547-8472-4954-8fc6-a152e9667437</entry>
Jul 27 13:40:30 user nova-compute[70914]:       <entry name="uuid">509e7547-8472-4954-8fc6-a152e9667437</entry>
Jul 27 13:40:30 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:40:30 user nova-compute[70914]:     </system>
Jul 27 13:40:30 user nova-compute[70914]:   </sysinfo>
Jul 27 13:40:30 user nova-compute[70914]:   <os>
Jul 27 13:40:30 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:40:30 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:40:30 user nova-compute[70914]:   </os>
Jul 27 13:40:30 user nova-compute[70914]:   <features>
Jul 27 13:40:30 user nova-compute[70914]:     <acpi/>
Jul 27 13:40:30 user nova-compute[70914]:     <apic/>
Jul 27 13:40:30 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:40:30 user nova-compute[70914]:   </features>
Jul 27 13:40:30 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:40:30 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:40:30 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:40:30 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:40:30 user nova-compute[70914]:   </clock>
Jul 27 13:40:30 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:40:30 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:40:30 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:40:30 user nova-compute[70914]:   </cpu>
Jul 27 13:40:30 user nova-compute[70914]:   <devices>
Jul 27 13:40:30 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:40:30 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:40:30 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk"/>
Jul 27 13:40:30 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:40:30 user nova-compute[70914]:     </disk>
Jul 27 13:40:30 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:40:30 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:40:30 user nova-compute[70914]:       <source dev="/dev/sdc"/>
Jul 27 13:40:30 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:40:30 user nova-compute[70914]:       <serial>c36b85f7-f21b-40fb-a7f8-34d88db9b4ba</serial>
Jul 27 13:40:30 user nova-compute[70914]:     </disk>
Jul 27 13:40:30 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:40:30 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:40:30 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue"/>
Jul 27 13:40:30 user nova-compute[70914]:       <target dev="vdc" bus="virtio"/>
Jul 27 13:40:30 user nova-compute[70914]:       <boot order="1"/>
Jul 27 13:40:30 user nova-compute[70914]:     </disk>
Jul 27 13:40:30 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:40:30 user nova-compute[70914]:       <mac address="fa:16:3e:8b:f4:cc"/>
Jul 27 13:40:30 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:40:30 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:40:30 user nova-compute[70914]:       <target dev="tap7c115254-d0"/>
Jul 27 13:40:30 user nova-compute[70914]:     </interface>
Jul 27 13:40:30 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:40:30 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/console.log" append="off"/>
Jul 27 13:40:30 user nova-compute[70914]:     </serial>
Jul 27 13:40:30 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:40:30 user nova-compute[70914]:     <video>
Jul 27 13:40:30 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:40:30 user nova-compute[70914]:     </video>
Jul 27 13:40:30 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:40:30 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:40:30 user nova-compute[70914]:     </rng>
Jul 27 13:40:30 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:40:30 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:40:30 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:40:30 user nova-compute[70914]:     </memballoon>
Jul 27 13:40:30 user nova-compute[70914]:   </devices>
Jul 27 13:40:30 user nova-compute[70914]: </domain>
Jul 27 13:40:30 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:40:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Instance destroyed successfully.
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] No VIF found with MAC fa:16:3e:8b:f4:cc, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:40:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:31 user nova-compute[70914]: INFO nova.compute.manager [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attaching volume b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 to /dev/vdb
Jul 27 13:40:32 user nova-compute[70914]: DEBUG os_brick.utils [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-514b998c-58ed-45da-87ad-d03ed28f894c req-7fa1e170-5505-47bf-b12a-9a9ff3d475ba service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-514b998c-58ed-45da-87ad-d03ed28f894c req-7fa1e170-5505-47bf-b12a-9a9ff3d475ba service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-514b998c-58ed-45da-87ad-d03ed28f894c req-7fa1e170-5505-47bf-b12a-9a9ff3d475ba service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-514b998c-58ed-45da-87ad-d03ed28f894c req-7fa1e170-5505-47bf-b12a-9a9ff3d475ba service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-514b998c-58ed-45da-87ad-d03ed28f894c req-7fa1e170-5505-47bf-b12a-9a9ff3d475ba service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:40:32 user nova-compute[70914]: WARNING nova.compute.manager [req-514b998c-58ed-45da-87ad-d03ed28f894c req-7fa1e170-5505-47bf-b12a-9a9ff3d475ba service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state active and task_state rescuing.
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b9cd11-9b71-4cfa-8514-8280fdfa887b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e221ea-985f-42c5-b175-8292667733ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a152bcd6-2149-45e4-bd7d-4fe488484f2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbca87a-2bf6-47ef-bae5-c2620c06f9c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:40:32 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:40:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e5d9e0-c7dd-4ade-b9d5-0e6e1291afcc]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG os_brick.utils [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Updating existing volume attachment record: 4e47d5f9-eae7-4fe0-9057-372ecacfc27f {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-8e512132-35a9-411c-91c7-55a0941779ac req-d39b0b2e-f135-4d0d-8c3b-8fc2baf0014b service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e512132-35a9-411c-91c7-55a0941779ac req-d39b0b2e-f135-4d0d-8c3b-8fc2baf0014b service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e512132-35a9-411c-91c7-55a0941779ac req-d39b0b2e-f135-4d0d-8c3b-8fc2baf0014b service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e512132-35a9-411c-91c7-55a0941779ac req-d39b0b2e-f135-4d0d-8c3b-8fc2baf0014b service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-8e512132-35a9-411c-91c7-55a0941779ac req-d39b0b2e-f135-4d0d-8c3b-8fc2baf0014b service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:40:34 user nova-compute[70914]: WARNING nova.compute.manager [req-8e512132-35a9-411c-91c7-55a0941779ac req-d39b0b2e-f135-4d0d-8c3b-8fc2baf0014b service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state active and task_state rescuing.
Jul 27 13:40:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for 509e7547-8472-4954-8fc6-a152e9667437 due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:40:34 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465234.246206, 509e7547-8472-4954-8fc6-a152e9667437 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:40:34 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] VM Resumed (Lifecycle Event)
Jul 27 13:40:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-04dc0935-abe6-4a1c-a61f-2eb48a76a64b tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:40:34 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 13:40:34 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465234.250933, 509e7547-8472-4954-8fc6-a152e9667437 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:40:34 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] VM Started (Lifecycle Event)
Jul 27 13:40:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:40:34 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 13:40:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:36 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:40:37 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:40:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:40:38 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:40:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:38 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:40:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edhGrQXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:40:39 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:40:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:40:39 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:40:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:40:39 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b6b05a-05ab-4a01-b1da-f23e3dbaa5fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:40:39 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac35d25-db7f-480c-b60f-0bfcc9170904]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92] added
Jul 27 13:40:39 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec34e107-5d84-49bb-ba26-dbd3ce430345]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4e97cb-b335-4853-a7a4-db65d28915de]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edhGrQXR {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edhGrQXR" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf0e82a-77cc-4fcd-b8e8-0a174841ccdf]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edhGrQXR'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[841af16e-3654-4b16-921b-d2e77dcbeae8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b26668-3178-4975-9ecd-039a4c1ebcbc]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:40 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:40:40 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:40 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:40:40 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed27643-f7ce-4cb5-90f6-5d94c2add2b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92, portal: 172.16.0.220,3260]
Jul 27 13:40:40 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92, portal: 172.16.0.220,3260] successful.
Jul 27 13:40:40 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9373e6bc-51ed-4687-9721-8a9c94ccd9c1]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fa52c1-66f2-4cfa-ba17-ec5b9b8a8ba3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:40 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:40:40 user nova-compute[70914]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 (non-flash)
Jul 27 13:40:40 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:40 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:40:40 user nova-compute[70914]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 (non-flash)
Jul 27 13:40:40 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ddbfc7-4686-431d-baad-2604efa407f2]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edhGrQXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '23638373262316131', 'path': '/dev/sdd'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638373262316131', 'path': '/dev/sdd'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG nova.objects.instance [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:40:41 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:40:41 user nova-compute[70914]:   <source dev="/dev/sdd"/>
Jul 27 13:40:41 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:40:41 user nova-compute[70914]:   <serial>b8ce4a3d-76bc-4044-98e6-b5a4a687fa92</serial>
Jul 27 13:40:41 user nova-compute[70914]: </disk>
Jul 27 13:40:41 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] No VIF found with MAC fa:16:3e:a7:1a:64, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-17bda7d9-e23d-47dc-9176-e4b0099ce6b0 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.191s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:40:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:43 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:40:43 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7287MB free_disk=25.45025634765625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 38108984-8bd8-49b6-9111-33c084a5a16a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 509e7547-8472-4954-8fc6-a152e9667437 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 10fa8c48-a95a-411f-9de0-aabf19455f57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:44 user nova-compute[70914]: INFO nova.compute.manager [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Detaching volume b8ce4a3d-76bc-4044-98e6-b5a4a687fa92
Jul 27 13:40:44 user nova-compute[70914]: INFO nova.virt.block_device [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Attempting to driver detach volume b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 from mountpoint /dev/vdb
Jul 27 13:40:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Attempting to detach device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:40:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:40:44 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:40:44 user nova-compute[70914]:   <source dev="/dev/sdd"/>
Jul 27 13:40:44 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:40:44 user nova-compute[70914]:   <serial>b8ce4a3d-76bc-4044-98e6-b5a4a687fa92</serial>
Jul 27 13:40:44 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:40:44 user nova-compute[70914]: </disk>
Jul 27 13:40:44 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:40:44 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Successfully detached device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the persistent domain config.
Jul 27 13:40:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:40:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:40:44 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:40:44 user nova-compute[70914]:   <source dev="/dev/sdd"/>
Jul 27 13:40:44 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:40:44 user nova-compute[70914]:   <serial>b8ce4a3d-76bc-4044-98e6-b5a4a687fa92</serial>
Jul 27 13:40:44 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:40:44 user nova-compute[70914]: </disk>
Jul 27 13:40:44 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:40:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:40:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:40:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465245.2931542, 72a9344d-135a-4283-b42e-cf0e5fb4bc75 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:40:45 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Successfully detached device vdb from instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 from the live domain config.
Jul 27 13:40:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edhGrQXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:40:45 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caa668e-3f3d-44bf-8d99-9ddd907f5d6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:40:45 user nova-compute[70914]: No targets found.
Jul 27 13:40:45 user nova-compute[70914]: iSNS:
Jul 27 13:40:45 user nova-compute[70914]: No targets found.
Jul 27 13:40:45 user nova-compute[70914]: STATIC:
Jul 27 13:40:45 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba
Jul 27 13:40:45 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:40:45 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:40:45 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:40:45 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:40:45 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:40:45 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92
Jul 27 13:40:45 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:40:45 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:40:45 user nova-compute[70914]: FIRMWARE:
Jul 27 13:40:45 user nova-compute[70914]: No targets found.
Jul 27 13:40:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:40:45 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:40:45 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[10920593-f822-4a65-9503-f837ce0ded9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdc96fb-5a17-4fe6-b2fc-080925684184]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:45 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:40:45 user nova-compute[70914]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 (non-flash)
Jul 27 13:40:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:40:45 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:40:45 user nova-compute[70914]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 (non-flash)
Jul 27 13:40:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c381e9120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92'): ({'sdd'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Removing single pathed devices sdd {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5583edc-a62c-4e67-9d1d-df39a3bb785c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec34825-0535-4ab0-8b04-45d26ddfa6c3]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Flushing IO for device /dev/sdd {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5052994-73e4-4597-b3b7-0396cc2e2134]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b5de87-85f4-485b-be6e-8fdc2ce639eb]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d64bad8-8124-485d-a7f5-22fa6bfe7f81]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd076c0-2c86-41c9-a515-f0cb3defb32c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92, portal: 172.16.0.220,3260]
Jul 27 13:40:45 user nova-compute[70914]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92, portal: 172.16.0.220,3260] successful.
Jul 27 13:40:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ce4a3d-76bc-4044-98e6-b5a4a687fa92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80907e4-9223-4e52-844e-55f4020a6568]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] <== disconnect_volume: return (308ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:40:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:40:46 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Updating instance_info_cache with network_info: [{"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:40:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-60c81594-3bfb-4c2c-ad6a-b9418f5c7651" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:40:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:40:46 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:40:46 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:40:46 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:40:46 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:40:46 user nova-compute[70914]: DEBUG nova.objects.instance [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'flavor' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-57cb793c-4362-4e10-8910-ec28646aac75 tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.856s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:40:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:40:49 user nova-compute[70914]: INFO nova.compute.claims [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Claim successful on node user
Jul 27 13:40:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG nova.network.neutron [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:40:50 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:40:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG nova.policy [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0d92b0b34814e75a7709e09e357be07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b177edc7249f798bca2c39a33394d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:40:50 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Creating image(s)
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk 1073741824" returned: 0 in 0.051s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG nova.network.neutron [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Successfully created port: bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Cannot resize image /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG nova.objects.instance [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'migration_context' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Ensure instance console log exists: /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG nova.network.neutron [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Successfully updated port: bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquired lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG nova.network.neutron [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-63143fa0-5a1d-4e3d-97b1-71eb0047b381 req-5ff8b096-7a5b-410f-9d58-fc26d1b8c61f service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-changed-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-63143fa0-5a1d-4e3d-97b1-71eb0047b381 req-5ff8b096-7a5b-410f-9d58-fc26d1b8c61f service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Refreshing instance network info cache due to event network-changed-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:40:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63143fa0-5a1d-4e3d-97b1-71eb0047b381 req-5ff8b096-7a5b-410f-9d58-fc26d1b8c61f service nova] Acquiring lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.network.neutron [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.network.neutron [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updating instance_info_cache with network_info: [{"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Releasing lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Instance network_info: |[{"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63143fa0-5a1d-4e3d-97b1-71eb0047b381 req-5ff8b096-7a5b-410f-9d58-fc26d1b8c61f service nova] Acquired lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-63143fa0-5a1d-4e3d-97b1-71eb0047b381 req-5ff8b096-7a5b-410f-9d58-fc26d1b8c61f service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Refreshing network info cache for port bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Start _get_guest_xml network_info=[{"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:40:52 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:40:52 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:40:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1493132680',display_name='tempest-ServerRescueNegativeTestJSON-server-1493132680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1493132680',id=21,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4wmNCkvYQYQ0qqix7wjwraQUsjHfZUo2ooBlM3iiRvi9NS0tf/RJ3lGNtR1r32zT+z7zkJqc3A8Zl6Yst1/6kaDIzOgs0nZKK5GNuqF6wrVURh+o6c7Be54NVRq1bOuA==',key_name='tempest-keypair-1352200146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-ndqp4fiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d92b0b34814e75a7709e09e357be07',uuid=30050776-6e41-487a-9ad2-342b18a7b72f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:40:9d,bridge_name='br-int',has_traffic_filtering=True,id=bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb7b48a-92') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.objects.instance [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'pci_devices' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:40:52 user nova-compute[70914]:   <uuid>30050776-6e41-487a-9ad2-342b18a7b72f</uuid>
Jul 27 13:40:52 user nova-compute[70914]:   <name>instance-00000015</name>
Jul 27 13:40:52 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:40:52 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:40:52 user nova-compute[70914]:   <metadata>
Jul 27 13:40:52 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:40:52 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:40:52 user nova-compute[70914]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1493132680</nova:name>
Jul 27 13:40:52 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:40:52</nova:creationTime>
Jul 27 13:40:52 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:40:52 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:40:52 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:40:52 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:40:52 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:40:52 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:40:52 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:40:52 user nova-compute[70914]:       <nova:owner>
Jul 27 13:40:52 user nova-compute[70914]:         <nova:user uuid="a0d92b0b34814e75a7709e09e357be07">tempest-ServerRescueNegativeTestJSON-1275773337-project-member</nova:user>
Jul 27 13:40:52 user nova-compute[70914]:         <nova:project uuid="097b177edc7249f798bca2c39a33394d">tempest-ServerRescueNegativeTestJSON-1275773337</nova:project>
Jul 27 13:40:52 user nova-compute[70914]:       </nova:owner>
Jul 27 13:40:52 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:40:52 user nova-compute[70914]:       <nova:ports>
Jul 27 13:40:52 user nova-compute[70914]:         <nova:port uuid="bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b">
Jul 27 13:40:52 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 13:40:52 user nova-compute[70914]:         </nova:port>
Jul 27 13:40:52 user nova-compute[70914]:       </nova:ports>
Jul 27 13:40:52 user nova-compute[70914]:     </nova:instance>
Jul 27 13:40:52 user nova-compute[70914]:   </metadata>
Jul 27 13:40:52 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:40:52 user nova-compute[70914]:     <system>
Jul 27 13:40:52 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:40:52 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:40:52 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:40:52 user nova-compute[70914]:       <entry name="serial">30050776-6e41-487a-9ad2-342b18a7b72f</entry>
Jul 27 13:40:52 user nova-compute[70914]:       <entry name="uuid">30050776-6e41-487a-9ad2-342b18a7b72f</entry>
Jul 27 13:40:52 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:40:52 user nova-compute[70914]:     </system>
Jul 27 13:40:52 user nova-compute[70914]:   </sysinfo>
Jul 27 13:40:52 user nova-compute[70914]:   <os>
Jul 27 13:40:52 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:40:52 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:40:52 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:40:52 user nova-compute[70914]:   </os>
Jul 27 13:40:52 user nova-compute[70914]:   <features>
Jul 27 13:40:52 user nova-compute[70914]:     <acpi/>
Jul 27 13:40:52 user nova-compute[70914]:     <apic/>
Jul 27 13:40:52 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:40:52 user nova-compute[70914]:   </features>
Jul 27 13:40:52 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:40:52 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:40:52 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:40:52 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:40:52 user nova-compute[70914]:   </clock>
Jul 27 13:40:52 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:40:52 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:40:52 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:40:52 user nova-compute[70914]:   </cpu>
Jul 27 13:40:52 user nova-compute[70914]:   <devices>
Jul 27 13:40:52 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:40:52 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:40:52 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk"/>
Jul 27 13:40:52 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:40:52 user nova-compute[70914]:     </disk>
Jul 27 13:40:52 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:40:52 user nova-compute[70914]:       <mac address="fa:16:3e:88:40:9d"/>
Jul 27 13:40:52 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:40:52 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:40:52 user nova-compute[70914]:       <target dev="tapbfb7b48a-92"/>
Jul 27 13:40:52 user nova-compute[70914]:     </interface>
Jul 27 13:40:52 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:40:52 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/console.log" append="off"/>
Jul 27 13:40:52 user nova-compute[70914]:     </serial>
Jul 27 13:40:52 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:40:52 user nova-compute[70914]:     <video>
Jul 27 13:40:52 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:40:52 user nova-compute[70914]:     </video>
Jul 27 13:40:52 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:40:52 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:40:52 user nova-compute[70914]:     </rng>
Jul 27 13:40:52 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:40:52 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:40:52 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:40:52 user nova-compute[70914]:     </memballoon>
Jul 27 13:40:52 user nova-compute[70914]:   </devices>
Jul 27 13:40:52 user nova-compute[70914]: </domain>
Jul 27 13:40:52 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:40:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1493132680',display_name='tempest-ServerRescueNegativeTestJSON-server-1493132680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1493132680',id=21,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4wmNCkvYQYQ0qqix7wjwraQUsjHfZUo2ooBlM3iiRvi9NS0tf/RJ3lGNtR1r32zT+z7zkJqc3A8Zl6Yst1/6kaDIzOgs0nZKK5GNuqF6wrVURh+o6c7Be54NVRq1bOuA==',key_name='tempest-keypair-1352200146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-ndqp4fiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d92b0b34814e75a7709e09e357be07',uuid=30050776-6e41-487a-9ad2-342b18a7b72f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:40:9d,bridge_name='br-int',has_traffic_filtering=True,id=bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb7b48a-92') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG os_vif [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:40:9d,bridge_name='br-int',has_traffic_filtering=True,id=bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb7b48a-92') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfb7b48a-92, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfb7b48a-92, col_values=(('external_ids', {'iface-id': 'bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:40:9d', 'vm-uuid': '30050776-6e41-487a-9ad2-342b18a7b72f'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:52 user nova-compute[70914]: INFO os_vif [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:40:9d,bridge_name='br-int',has_traffic_filtering=True,id=bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb7b48a-92')
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No VIF found with MAC fa:16:3e:88:40:9d, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-63143fa0-5a1d-4e3d-97b1-71eb0047b381 req-5ff8b096-7a5b-410f-9d58-fc26d1b8c61f service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updated VIF entry in instance network info cache for port bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-63143fa0-5a1d-4e3d-97b1-71eb0047b381 req-5ff8b096-7a5b-410f-9d58-fc26d1b8c61f service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updating instance_info_cache with network_info: [{"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:40:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-63143fa0-5a1d-4e3d-97b1-71eb0047b381 req-5ff8b096-7a5b-410f-9d58-fc26d1b8c61f service nova] Releasing lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:40:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-d8d8922e-4a02-43c0-9183-13a9fc8d3d34 req-cbd97759-9675-4f05-a08e-084a2ece6858 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d8d8922e-4a02-43c0-9183-13a9fc8d3d34 req-cbd97759-9675-4f05-a08e-084a2ece6858 service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d8d8922e-4a02-43c0-9183-13a9fc8d3d34 req-cbd97759-9675-4f05-a08e-084a2ece6858 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d8d8922e-4a02-43c0-9183-13a9fc8d3d34 req-cbd97759-9675-4f05-a08e-084a2ece6858 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-d8d8922e-4a02-43c0-9183-13a9fc8d3d34 req-cbd97759-9675-4f05-a08e-084a2ece6858 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:40:54 user nova-compute[70914]: WARNING nova.compute.manager [req-d8d8922e-4a02-43c0-9183-13a9fc8d3d34 req-cbd97759-9675-4f05-a08e-084a2ece6858 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state building and task_state spawning.
Jul 27 13:40:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465256.1486704, 30050776-6e41-487a-9ad2-342b18a7b72f => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:40:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] VM Resumed (Lifecycle Event)
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:40:56 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Instance spawned successfully.
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-42c202b5-a0c5-451b-8fa4-286b7455bd19 req-7a8bd077-6708-4c1d-b0f7-1326efb6ed9d service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-42c202b5-a0c5-451b-8fa4-286b7455bd19 req-7a8bd077-6708-4c1d-b0f7-1326efb6ed9d service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-42c202b5-a0c5-451b-8fa4-286b7455bd19 req-7a8bd077-6708-4c1d-b0f7-1326efb6ed9d service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-42c202b5-a0c5-451b-8fa4-286b7455bd19 req-7a8bd077-6708-4c1d-b0f7-1326efb6ed9d service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-42c202b5-a0c5-451b-8fa4-286b7455bd19 req-7a8bd077-6708-4c1d-b0f7-1326efb6ed9d service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:40:56 user nova-compute[70914]: WARNING nova.compute.manager [req-42c202b5-a0c5-451b-8fa4-286b7455bd19 req-7a8bd077-6708-4c1d-b0f7-1326efb6ed9d service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state building and task_state spawning.
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:40:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465256.1517289, 30050776-6e41-487a-9ad2-342b18a7b72f => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:40:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] VM Started (Lifecycle Event)
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:40:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:40:56 user nova-compute[70914]: INFO nova.compute.manager [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Took 5.75 seconds to spawn the instance on the hypervisor.
Jul 27 13:40:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:40:56 user nova-compute[70914]: INFO nova.compute.manager [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Took 6.66 seconds to build instance.
Jul 27 13:40:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-33198a60-5d26-44bd-bb4a-0be6ccfd930f tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.772s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:40:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:58 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:40:58 user nova-compute[70914]: INFO nova.compute.claims [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Claim successful on node user
Jul 27 13:40:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.objects.instance [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'flavor' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.network.neutron [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:40:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.policy [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93a3be9b082b4facadeff78db34d2519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61774ce82df2478186c9bbed654b8c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:59 user nova-compute[70914]: INFO nova.compute.manager [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Attaching volume 26050a23-0784-4dcc-acaa-3aa249154c33 to /dev/vdb
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:40:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Creating image(s)
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "/opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "/opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG os_brick.utils [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[838f0ff2-686c-4c89-8703-75919d9c68bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae174c3-d5ce-4778-9617-969e7db64b5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90511f6-74f2-468e-bf24-5e888511b7ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dee24f7-584c-439c-9ee5-1d71682539b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.186s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:40:59 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f53ddc-9eda-4205-8874-f1130e8800d8]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG os_brick.utils [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updating existing volume attachment record: 863a6e10-57a2-4596-ae0d-a81427227dda {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.186s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk 1073741824" returned: 0 in 0.214s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.406s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:40:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG nova.network.neutron [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Successfully created port: 0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.160s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Cannot resize image /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG nova.objects.instance [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lazy-loading 'migration_context' on Instance uuid 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Ensure instance console log exists: /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Successfully updated port: 0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "refresh_cache-4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquired lock "refresh_cache-4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-10b43c35-375f-44d7-8f5a-443f56d0576c req-39c51204-2aec-4be0-a70d-c73447ea2eb5 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Received event network-changed-0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-10b43c35-375f-44d7-8f5a-443f56d0576c req-39c51204-2aec-4be0-a70d-c73447ea2eb5 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Refreshing instance network info cache due to event network-changed-0a721ac6-a5cf-497f-b49c-684ebc9eff7d. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-10b43c35-375f-44d7-8f5a-443f56d0576c req-39c51204-2aec-4be0-a70d-c73447ea2eb5 service nova] Acquiring lock "refresh_cache-4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Updating instance_info_cache with network_info: [{"id": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "address": "fa:16:3e:e5:8d:a8", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a721ac6-a5", "ovs_interfaceid": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Releasing lock "refresh_cache-4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Instance network_info: |[{"id": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "address": "fa:16:3e:e5:8d:a8", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a721ac6-a5", "ovs_interfaceid": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-10b43c35-375f-44d7-8f5a-443f56d0576c req-39c51204-2aec-4be0-a70d-c73447ea2eb5 service nova] Acquired lock "refresh_cache-4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.network.neutron [req-10b43c35-375f-44d7-8f5a-443f56d0576c req-39c51204-2aec-4be0-a70d-c73447ea2eb5 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Refreshing network info cache for port 0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Start _get_guest_xml network_info=[{"id": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "address": "fa:16:3e:e5:8d:a8", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a721ac6-a5", "ovs_interfaceid": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:41:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:41:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1390022186',display_name='tempest-VolumesAdminNegativeTest-server-1390022186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1390022186',id=22,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61774ce82df2478186c9bbed654b8c4d',ramdisk_id='',reservation_id='r-ojlr901a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1597280425',owner_user_name='tempest-VolumesAdminNegativeTest-1597280425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:40:59Z,user_data=None,user_id='93a3be9b082b4facadeff78db34d2519',uuid=4fd926d9-5cc3-4e14-83cc-f19ab8b84c31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "address": "fa:16:3e:e5:8d:a8", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a721ac6-a5", "ovs_interfaceid": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converting VIF {"id": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "address": "fa:16:3e:e5:8d:a8", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a721ac6-a5", "ovs_interfaceid": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a721ac6-a5cf-497f-b49c-684ebc9eff7d,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a721ac6-a5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.objects.instance [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:41:01 user nova-compute[70914]:   <uuid>4fd926d9-5cc3-4e14-83cc-f19ab8b84c31</uuid>
Jul 27 13:41:01 user nova-compute[70914]:   <name>instance-00000016</name>
Jul 27 13:41:01 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:41:01 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:41:01 user nova-compute[70914]:   <metadata>
Jul 27 13:41:01 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:41:01 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:41:01 user nova-compute[70914]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1390022186</nova:name>
Jul 27 13:41:01 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:41:01</nova:creationTime>
Jul 27 13:41:01 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:41:01 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:41:01 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:41:01 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:41:01 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:41:01 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:41:01 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:41:01 user nova-compute[70914]:       <nova:owner>
Jul 27 13:41:01 user nova-compute[70914]:         <nova:user uuid="93a3be9b082b4facadeff78db34d2519">tempest-VolumesAdminNegativeTest-1597280425-project-member</nova:user>
Jul 27 13:41:01 user nova-compute[70914]:         <nova:project uuid="61774ce82df2478186c9bbed654b8c4d">tempest-VolumesAdminNegativeTest-1597280425</nova:project>
Jul 27 13:41:01 user nova-compute[70914]:       </nova:owner>
Jul 27 13:41:01 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:41:01 user nova-compute[70914]:       <nova:ports>
Jul 27 13:41:01 user nova-compute[70914]:         <nova:port uuid="0a721ac6-a5cf-497f-b49c-684ebc9eff7d">
Jul 27 13:41:01 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:41:01 user nova-compute[70914]:         </nova:port>
Jul 27 13:41:01 user nova-compute[70914]:       </nova:ports>
Jul 27 13:41:01 user nova-compute[70914]:     </nova:instance>
Jul 27 13:41:01 user nova-compute[70914]:   </metadata>
Jul 27 13:41:01 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:41:01 user nova-compute[70914]:     <system>
Jul 27 13:41:01 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:41:01 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:41:01 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:41:01 user nova-compute[70914]:       <entry name="serial">4fd926d9-5cc3-4e14-83cc-f19ab8b84c31</entry>
Jul 27 13:41:01 user nova-compute[70914]:       <entry name="uuid">4fd926d9-5cc3-4e14-83cc-f19ab8b84c31</entry>
Jul 27 13:41:01 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:41:01 user nova-compute[70914]:     </system>
Jul 27 13:41:01 user nova-compute[70914]:   </sysinfo>
Jul 27 13:41:01 user nova-compute[70914]:   <os>
Jul 27 13:41:01 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:41:01 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:41:01 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:41:01 user nova-compute[70914]:   </os>
Jul 27 13:41:01 user nova-compute[70914]:   <features>
Jul 27 13:41:01 user nova-compute[70914]:     <acpi/>
Jul 27 13:41:01 user nova-compute[70914]:     <apic/>
Jul 27 13:41:01 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:41:01 user nova-compute[70914]:   </features>
Jul 27 13:41:01 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:41:01 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:41:01 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:41:01 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:41:01 user nova-compute[70914]:   </clock>
Jul 27 13:41:01 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:41:01 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:41:01 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:41:01 user nova-compute[70914]:   </cpu>
Jul 27 13:41:01 user nova-compute[70914]:   <devices>
Jul 27 13:41:01 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:41:01 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:41:01 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk"/>
Jul 27 13:41:01 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:41:01 user nova-compute[70914]:     </disk>
Jul 27 13:41:01 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:41:01 user nova-compute[70914]:       <mac address="fa:16:3e:e5:8d:a8"/>
Jul 27 13:41:01 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:41:01 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:41:01 user nova-compute[70914]:       <target dev="tap0a721ac6-a5"/>
Jul 27 13:41:01 user nova-compute[70914]:     </interface>
Jul 27 13:41:01 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:41:01 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/console.log" append="off"/>
Jul 27 13:41:01 user nova-compute[70914]:     </serial>
Jul 27 13:41:01 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:41:01 user nova-compute[70914]:     <video>
Jul 27 13:41:01 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:41:01 user nova-compute[70914]:     </video>
Jul 27 13:41:01 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:41:01 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:41:01 user nova-compute[70914]:     </rng>
Jul 27 13:41:01 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:41:01 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:41:01 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:41:01 user nova-compute[70914]:     </memballoon>
Jul 27 13:41:01 user nova-compute[70914]:   </devices>
Jul 27 13:41:01 user nova-compute[70914]: </domain>
Jul 27 13:41:01 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1390022186',display_name='tempest-VolumesAdminNegativeTest-server-1390022186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1390022186',id=22,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61774ce82df2478186c9bbed654b8c4d',ramdisk_id='',reservation_id='r-ojlr901a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1597280425',owner_user_name='tempest-VolumesAdminNegativeTest-1597280425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:40:59Z,user_data=None,user_id='93a3be9b082b4facadeff78db34d2519',uuid=4fd926d9-5cc3-4e14-83cc-f19ab8b84c31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "address": "fa:16:3e:e5:8d:a8", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a721ac6-a5", "ovs_interfaceid": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converting VIF {"id": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "address": "fa:16:3e:e5:8d:a8", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a721ac6-a5", "ovs_interfaceid": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a721ac6-a5cf-497f-b49c-684ebc9eff7d,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a721ac6-a5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG os_vif [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a721ac6-a5cf-497f-b49c-684ebc9eff7d,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a721ac6-a5') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a721ac6-a5, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a721ac6-a5, col_values=(('external_ids', {'iface-id': '0a721ac6-a5cf-497f-b49c-684ebc9eff7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:8d:a8', 'vm-uuid': '4fd926d9-5cc3-4e14-83cc-f19ab8b84c31'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:01 user nova-compute[70914]: INFO os_vif [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a721ac6-a5cf-497f-b49c-684ebc9eff7d,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a721ac6-a5')
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:41:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] No VIF found with MAC fa:16:3e:e5:8d:a8, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:41:02 user nova-compute[70914]: DEBUG nova.network.neutron [req-10b43c35-375f-44d7-8f5a-443f56d0576c req-39c51204-2aec-4be0-a70d-c73447ea2eb5 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Updated VIF entry in instance network info cache for port 0a721ac6-a5cf-497f-b49c-684ebc9eff7d. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:41:02 user nova-compute[70914]: DEBUG nova.network.neutron [req-10b43c35-375f-44d7-8f5a-443f56d0576c req-39c51204-2aec-4be0-a70d-c73447ea2eb5 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Updating instance_info_cache with network_info: [{"id": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "address": "fa:16:3e:e5:8d:a8", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a721ac6-a5", "ovs_interfaceid": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:41:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-10b43c35-375f-44d7-8f5a-443f56d0576c req-39c51204-2aec-4be0-a70d-c73447ea2eb5 service nova] Releasing lock "refresh_cache-4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:41:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-5995cb19-d369-404e-affb-923b6f9e19e2 req-1c4f1c84-7731-4c49-806b-eac53a708c18 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Received event network-vif-plugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5995cb19-d369-404e-affb-923b6f9e19e2 req-1c4f1c84-7731-4c49-806b-eac53a708c18 service nova] Acquiring lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5995cb19-d369-404e-affb-923b6f9e19e2 req-1c4f1c84-7731-4c49-806b-eac53a708c18 service nova] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5995cb19-d369-404e-affb-923b6f9e19e2 req-1c4f1c84-7731-4c49-806b-eac53a708c18 service nova] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-5995cb19-d369-404e-affb-923b6f9e19e2 req-1c4f1c84-7731-4c49-806b-eac53a708c18 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] No waiting events found dispatching network-vif-plugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:41:03 user nova-compute[70914]: WARNING nova.compute.manager [req-5995cb19-d369-404e-affb-923b6f9e19e2 req-1c4f1c84-7731-4c49-806b-eac53a708c18 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Received unexpected event network-vif-plugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d for instance with vm_state building and task_state spawning.
Jul 27 13:41:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465265.3545215, 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:41:05 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] VM Resumed (Lifecycle Event)
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:41:05 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Instance spawned successfully.
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:05 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465265.3556714, 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:41:05 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] VM Started (Lifecycle Event)
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-b86891d0-898e-4a57-b0b0-ec4024cbbe38 req-ae8007ef-6426-4ac5-83fe-c3654361a96e service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Received event network-vif-plugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b86891d0-898e-4a57-b0b0-ec4024cbbe38 req-ae8007ef-6426-4ac5-83fe-c3654361a96e service nova] Acquiring lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b86891d0-898e-4a57-b0b0-ec4024cbbe38 req-ae8007ef-6426-4ac5-83fe-c3654361a96e service nova] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b86891d0-898e-4a57-b0b0-ec4024cbbe38 req-ae8007ef-6426-4ac5-83fe-c3654361a96e service nova] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-b86891d0-898e-4a57-b0b0-ec4024cbbe38 req-ae8007ef-6426-4ac5-83fe-c3654361a96e service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] No waiting events found dispatching network-vif-plugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:41:05 user nova-compute[70914]: WARNING nova.compute.manager [req-b86891d0-898e-4a57-b0b0-ec4024cbbe38 req-ae8007ef-6426-4ac5-83fe-c3654361a96e service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Received unexpected event network-vif-plugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d for instance with vm_state building and task_state spawning.
Jul 27 13:41:05 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:41:05 user nova-compute[70914]: INFO nova.compute.manager [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Took 6.14 seconds to spawn the instance on the hypervisor.
Jul 27 13:41:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:41:05 user nova-compute[70914]: INFO nova.compute.manager [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Took 7.33 seconds to build instance.
Jul 27 13:41:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-719b1e32-1542-4459-bde4-e5efbe6476f2 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.440s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdPUNMWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:41:07 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:41:07 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:41:07 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e350ef0c-6697-4525-9a66-e734221baea6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:41:07 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[92850660-4ccb-4447-904d-0cf631ac9d48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33] added
Jul 27 13:41:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.070s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13e4f64-6c72-4f5d-be8a-cef8e050e784]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a20fc5-664b-4736-880e-c477f42f23b2]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdPUNMWe {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdPUNMWe" returned: 0 in 0.037s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[33db8b3b-32f8-416c-b194-51f69f8dd5c3]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RdPUNMWe'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[db15d750-fdae-41a9-8927-5e0755422b4a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd567a6-a16e-42ae-a0b8-4ac350ca12a5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:41:07 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:41:07 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c954307d-e62e-4b13-9ddf-7ca6b348a374]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260]
Jul 27 13:41:07 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260] successful.
Jul 27 13:41:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0ac905-8dfe-4363-9080-e4285aa4e65f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a7e42-78f3-48fb-a2d6-d3f3ff8d8704]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:41:07 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:07 user nova-compute[70914]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:41:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:41:07 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:07 user nova-compute[70914]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:41:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d75377-235f-4e22-a21d-2a3499ee1322]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:41:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdPUNMWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:08 user nova-compute[70914]: INFO nova.compute.manager [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Terminating instance
Jul 27 13:41:08 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23730353666316533', 'path': '/dev/sdd'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730353666316533', 'path': '/dev/sdd'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG nova.objects.instance [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'flavor' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:41:08 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:41:08 user nova-compute[70914]:   <source dev="/dev/sdd"/>
Jul 27 13:41:08 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:41:08 user nova-compute[70914]:   <serial>26050a23-0784-4dcc-acaa-3aa249154c33</serial>
Jul 27 13:41:08 user nova-compute[70914]: </disk>
Jul 27 13:41:08 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-bf251237-36d0-4209-84bc-bffd76bc8561 req-862dfd05-a26c-4cf3-953f-07ad37dcbeeb service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bf251237-36d0-4209-84bc-bffd76bc8561 req-862dfd05-a26c-4cf3-953f-07ad37dcbeeb service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bf251237-36d0-4209-84bc-bffd76bc8561 req-862dfd05-a26c-4cf3-953f-07ad37dcbeeb service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bf251237-36d0-4209-84bc-bffd76bc8561 req-862dfd05-a26c-4cf3-953f-07ad37dcbeeb service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-bf251237-36d0-4209-84bc-bffd76bc8561 req-862dfd05-a26c-4cf3-953f-07ad37dcbeeb service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:41:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-bf251237-36d0-4209-84bc-bffd76bc8561 req-862dfd05-a26c-4cf3-953f-07ad37dcbeeb service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-unplugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:41:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Instance destroyed successfully.
Jul 27 13:41:09 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lazy-loading 'resources' on Instance uuid 38108984-8bd8-49b6-9111-33c084a5a16a {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1925007786',display_name='tempest-ServerActionsTestOtherB-server-1925007786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1925007786',id=5,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHExeREDDPpeeto4dRdX/RKJZ83dPJH4sXgXTDLxmQ+8ZlOJR2MBG7t/gorV67US4l275/41OOOBwoDR8FgADW9jHIAHwwSPLUWO/b4tEzLREH2uqa5IWe2ftSKsaPh2Hw==',key_name='tempest-keypair-168588775',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a180220b142349188245dd88298da020',ramdisk_id='',reservation_id='r-so1tb3rb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-874236545',owner_user_name='tempest-ServerActionsTestOtherB-874236545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe9d73d3e87c4ad4a1ff9afb4ee6a9b0',uuid=38108984-8bd8-49b6-9111-33c084a5a16a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converting VIF {"id": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "address": "fa:16:3e:5c:af:6f", "network": {"id": "910126cc-9beb-4465-ade4-92ebd39b0afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-784097649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a180220b142349188245dd88298da020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2390d8-70", "ovs_interfaceid": "ae2390d8-702c-478a-8f63-ff3c36403dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_vif [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae2390d8-70, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:41:09 user nova-compute[70914]: INFO os_vif [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:6f,bridge_name='br-int',has_traffic_filtering=True,id=ae2390d8-702c-478a-8f63-ff3c36403dc3,network=Network(910126cc-9beb-4465-ade4-92ebd39b0afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2390d8-70')
Jul 27 13:41:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgeofZBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:41:09 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No VIF found with MAC fa:16:3e:f6:64:4a, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6c954f-a7ba-4d4f-87dd-ae8c59e4e2b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:41:09 user nova-compute[70914]: No targets found.
Jul 27 13:41:09 user nova-compute[70914]: iSNS:
Jul 27 13:41:09 user nova-compute[70914]: No targets found.
Jul 27 13:41:09 user nova-compute[70914]: STATIC:
Jul 27 13:41:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba
Jul 27 13:41:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:41:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:41:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98
Jul 27 13:41:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:41:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:41:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33
Jul 27 13:41:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:41:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:41:09 user nova-compute[70914]: FIRMWARE:
Jul 27 13:41:09 user nova-compute[70914]: No targets found.
Jul 27 13:41:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:41:09 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:41:09 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c0fc5b-9b9d-43cb-91ef-4e3224348eff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44e4a7d-6dab-4a4d-b9e4-95339f19f203]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:41:09 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:09 user nova-compute[70914]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:41:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 (non-flash)
Jul 27 13:41:09 user nova-compute[70914]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:09 user nova-compute[70914]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:41:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c381eb400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f863900-5988-4569-b3cd-134f029ae91a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce456726-29f9-4de4-8885-9dbbee5f57a5]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-358341ad-1e9b-4808-be50-3cc3895aec97 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.556s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c58efeb-4ed7-48fa-a16b-2ab1e09e2b54]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[db84d478-2379-47bd-b0da-de6f49faf9a7]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce828d2-9e28-4e80-a5ea-df2b8c287e2c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0512ac93-6bc8-4633-9562-42638a6d06a4]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260]
Jul 27 13:41:10 user nova-compute[70914]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98, portal: 172.16.0.220,3260] successful.
Jul 27 13:41:10 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df6dc3b-018b-4dfb-afb9-6a2efcda4b98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fe46f4-e6e7-42fe-8f7f-6b3a3df3cbb2]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.562s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] <== disconnect_volume: return (563ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:41:10 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Deleting instance files /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a_del
Jul 27 13:41:10 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Deletion of /opt/stack/data/nova/instances/38108984-8bd8-49b6-9111-33c084a5a16a_del complete
Jul 27 13:41:10 user nova-compute[70914]: INFO nova.compute.manager [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Took 1.88 seconds to destroy the instance on the hypervisor.
Jul 27 13:41:10 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:41:10 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:41:11 user nova-compute[70914]: INFO nova.compute.manager [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Rebuilding instance
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-933f8760-352a-4f84-b200-f89ae46a8f3b req-b2273868-fae7-4ef6-bcbd-f4344bc2668d service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-933f8760-352a-4f84-b200-f89ae46a8f3b req-b2273868-fae7-4ef6-bcbd-f4344bc2668d service nova] Acquiring lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-933f8760-352a-4f84-b200-f89ae46a8f3b req-b2273868-fae7-4ef6-bcbd-f4344bc2668d service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-933f8760-352a-4f84-b200-f89ae46a8f3b req-b2273868-fae7-4ef6-bcbd-f4344bc2668d service nova] Lock "38108984-8bd8-49b6-9111-33c084a5a16a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-933f8760-352a-4f84-b200-f89ae46a8f3b req-b2273868-fae7-4ef6-bcbd-f4344bc2668d service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] No waiting events found dispatching network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:41:11 user nova-compute[70914]: WARNING nova.compute.manager [req-933f8760-352a-4f84-b200-f89ae46a8f3b req-b2273868-fae7-4ef6-bcbd-f4344bc2668d service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received unexpected event network-vif-plugged-ae2390d8-702c-478a-8f63-ff3c36403dc3 for instance with vm_state active and task_state deleting.
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'trusted_certs' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'pci_requests' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'pci_devices' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'resources' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'migration_context' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70914) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-c3077d23-d8f9-466f-be30-557a32ff64eb req-413ccf43-8f91-4439-8c4d-841444b117f4 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-vif-unplugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c3077d23-d8f9-466f-be30-557a32ff64eb req-413ccf43-8f91-4439-8c4d-841444b117f4 service nova] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c3077d23-d8f9-466f-be30-557a32ff64eb req-413ccf43-8f91-4439-8c4d-841444b117f4 service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c3077d23-d8f9-466f-be30-557a32ff64eb req-413ccf43-8f91-4439-8c4d-841444b117f4 service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-c3077d23-d8f9-466f-be30-557a32ff64eb req-413ccf43-8f91-4439-8c4d-841444b117f4 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] No waiting events found dispatching network-vif-unplugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:41:11 user nova-compute[70914]: WARNING nova.compute.manager [req-c3077d23-d8f9-466f-be30-557a32ff64eb req-413ccf43-8f91-4439-8c4d-841444b117f4 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received unexpected event network-vif-unplugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 for instance with vm_state active and task_state rebuilding.
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:41:11 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Took 1.62 seconds to deallocate network for instance.
Jul 27 13:41:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-3ff31bc9-2171-4354-99fd-c953236d830b req-a139fbd2-83bc-4689-83f8-1da9e3d2cff3 service nova] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Received event network-vif-deleted-ae2390d8-702c-478a-8f63-ff3c36403dc3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:12 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Instance destroyed successfully.
Jul 27 13:41:12 user nova-compute[70914]: INFO nova.compute.manager [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Detaching volume 26050a23-0784-4dcc-acaa-3aa249154c33
Jul 27 13:41:12 user nova-compute[70914]: INFO nova.virt.block_device [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Attempting to driver detach volume 26050a23-0784-4dcc-acaa-3aa249154c33 from mountpoint /dev/vdb
Jul 27 13:41:12 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Attempting to detach device vdb from instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:41:12 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:41:12 user nova-compute[70914]:   <source dev="/dev/sdd"/>
Jul 27 13:41:12 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:41:12 user nova-compute[70914]:   <serial>26050a23-0784-4dcc-acaa-3aa249154c33</serial>
Jul 27 13:41:12 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:41:12 user nova-compute[70914]: </disk>
Jul 27 13:41:12 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:41:12 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully detached device vdb from instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 from the persistent domain config.
Jul 27 13:41:12 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdPUNMWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:41:12 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[636425c2-4a4f-4fa9-a4a2-fee115373d7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:41:12 user nova-compute[70914]: No targets found.
Jul 27 13:41:12 user nova-compute[70914]: iSNS:
Jul 27 13:41:12 user nova-compute[70914]: No targets found.
Jul 27 13:41:12 user nova-compute[70914]: STATIC:
Jul 27 13:41:12 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba
Jul 27 13:41:12 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:41:12 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:41:12 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33
Jul 27 13:41:12 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:41:12 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:41:12 user nova-compute[70914]: FIRMWARE:
Jul 27 13:41:12 user nova-compute[70914]: No targets found.
Jul 27 13:41:12 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:41:12 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:41:12 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6da182-23ea-42ab-979c-aa8b5d13df80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e141976-e899-495c-ba57-3c892d40e06c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:12 user nova-compute[70914]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:41:12 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:12 user nova-compute[70914]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:41:12 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c187b6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33'): ({'sdd'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Removing single pathed devices sdd {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca25bd6c-c9ae-491c-834d-9d95c675253f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bba38c-b9d8-4c89-94df-ee5a3a9b9a4d]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flushing IO for device /dev/sdd {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9ad4fd-7786-4576-9b81-d813d177d0a3]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[064543cd-5e6e-4773-bf77-2589a101e9d5]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0739636a-f0d6-40ae-85dc-91badda8a22b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7745400d-bbfd-4f1c-a3d9-ba193d91f0fd]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260]
Jul 27 13:41:12 user nova-compute[70914]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260] successful.
Jul 27 13:41:12 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:12 user nova-compute[70914]: INFO nova.compute.manager [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Took 0.93 seconds to detach 1 volumes for instance.
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4ba365-482d-4d99-95c0-c6f24cb07e69]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== disconnect_volume: return (384ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:13 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Deleted allocations for instance 38108984-8bd8-49b6-9111-33c084a5a16a
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c0af785a-97c1-4b94-a726-fd6d013a149d tempest-ServerActionsTestOtherB-874236545 tempest-ServerActionsTestOtherB-874236545-project-member] Lock "38108984-8bd8-49b6-9111-33c084a5a16a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.129s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Instance destroyed successfully.
Jul 27 13:41:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-930458355',display_name='tempest-ServerActionsTestOtherA-server-85355233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-930458355',id=17,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-82o8h0rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:41:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=814e062c-85d1-486b-8c7e-9198fbfc5f63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_vif [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31f7f5f5-e9, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:41:13 user nova-compute[70914]: INFO os_vif [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9')
Jul 27 13:41:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdPUNMWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:41:13 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f6b96-61eb-400c-89f6-2fab996372f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:41:13 user nova-compute[70914]: No targets found.
Jul 27 13:41:13 user nova-compute[70914]: iSNS:
Jul 27 13:41:13 user nova-compute[70914]: No targets found.
Jul 27 13:41:13 user nova-compute[70914]: STATIC:
Jul 27 13:41:13 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba
Jul 27 13:41:13 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:41:13 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:41:13 user nova-compute[70914]: FIRMWARE:
Jul 27 13:41:13 user nova-compute[70914]: No targets found.
Jul 27 13:41:13 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:41:13 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:41:13 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f163024-eee3-4e8b-84f0-74b28031e2ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-22ab9657-4996-4199-b4e3-0c9acb8a41a5 req-606a834c-5fa8-4f3a-a522-fb20559ff82f service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-22ab9657-4996-4199-b4e3-0c9acb8a41a5 req-606a834c-5fa8-4f3a-a522-fb20559ff82f service nova] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-22ab9657-4996-4199-b4e3-0c9acb8a41a5 req-606a834c-5fa8-4f3a-a522-fb20559ff82f service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-22ab9657-4996-4199-b4e3-0c9acb8a41a5 req-606a834c-5fa8-4f3a-a522-fb20559ff82f service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-22ab9657-4996-4199-b4e3-0c9acb8a41a5 req-606a834c-5fa8-4f3a-a522-fb20559ff82f service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] No waiting events found dispatching network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:41:13 user nova-compute[70914]: WARNING nova.compute.manager [req-22ab9657-4996-4199-b4e3-0c9acb8a41a5 req-606a834c-5fa8-4f3a-a522-fb20559ff82f service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received unexpected event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 for instance with vm_state active and task_state rebuilding.
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f853c5-6bfa-4102-b32b-c7860c62e475]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:13 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:13 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf875ce50>, {}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Disconnecting from: [] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.106s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== disconnect_volume: return (108ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:41:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:41:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Deleting instance files /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63_del
Jul 27 13:41:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Deletion of /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63_del complete
Jul 27 13:41:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:13 user nova-compute[70914]: INFO nova.virt.block_device [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Booting with volume 26050a23-0784-4dcc-acaa-3aa249154c33 at /dev/vdb
Jul 27 13:41:14 user nova-compute[70914]: DEBUG os_brick.utils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ebcd22-933c-409e-81ce-fb2c8974cf9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4fc3ac-0586-4a4d-9ba1-eb69bd80138e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e861b80d-ca32-4b36-98eb-1fc2daa0ecbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd22923-f590-4e9d-bd42-939149ec36d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:41:14 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:41:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[01762c23-1201-4610-bf29-2f999f8ac8b5]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG os_brick.utils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:41:14 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updating existing volume attachment record: ed61adbc-e6f0-4a2c-97bb-ab4a889e5ef3 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:18 user nova-compute[70914]: INFO nova.compute.manager [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Terminating instance
Jul 27 13:41:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-207fbfce-f975-4128-8c9f-ad574cafe739 req-96163637-f0f5-4178-b370-23456044e69f service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Received event network-vif-unplugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-207fbfce-f975-4128-8c9f-ad574cafe739 req-96163637-f0f5-4178-b370-23456044e69f service nova] Acquiring lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-207fbfce-f975-4128-8c9f-ad574cafe739 req-96163637-f0f5-4178-b370-23456044e69f service nova] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-207fbfce-f975-4128-8c9f-ad574cafe739 req-96163637-f0f5-4178-b370-23456044e69f service nova] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-207fbfce-f975-4128-8c9f-ad574cafe739 req-96163637-f0f5-4178-b370-23456044e69f service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] No waiting events found dispatching network-vif-unplugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-207fbfce-f975-4128-8c9f-ad574cafe739 req-96163637-f0f5-4178-b370-23456044e69f service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Received event network-vif-unplugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Instance destroyed successfully.
Jul 27 13:41:19 user nova-compute[70914]: DEBUG nova.objects.instance [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lazy-loading 'resources' on Instance uuid 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-298963430',display_name='tempest-ServersNegativeTestJSON-server-298963430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-298963430',id=4,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e59369b8cbb148fc9d60ef1513579205',ramdisk_id='',reservation_id='r-960x84r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1243391903',owner_user_name='tempest-ServersNegativeTestJSON-1243391903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:32:41Z,user_data=None,user_id='84825f59c7be48698b64b0f24ab85b1e',uuid=60c81594-3bfb-4c2c-ad6a-b9418f5c7651,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:41:19 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converting VIF {"id": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "address": "fa:16:3e:90:96:50", "network": {"id": "43165b19-69ae-43fc-b1e7-d1d08c7011ee", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-82258203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59369b8cbb148fc9d60ef1513579205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a7bc1b-e5", "ovs_interfaceid": "07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:41:19 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:96:50,bridge_name='br-int',has_traffic_filtering=True,id=07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a7bc1b-e5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:41:19 user nova-compute[70914]: DEBUG os_vif [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:96:50,bridge_name='br-int',has_traffic_filtering=True,id=07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a7bc1b-e5') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:41:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07a7bc1b-e5, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:41:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:19 user nova-compute[70914]: INFO os_vif [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:96:50,bridge_name='br-int',has_traffic_filtering=True,id=07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a,network=Network(43165b19-69ae-43fc-b1e7-d1d08c7011ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a7bc1b-e5')
Jul 27 13:41:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Deleting instance files /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651_del
Jul 27 13:41:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Deletion of /opt/stack/data/nova/instances/60c81594-3bfb-4c2c-ad6a-b9418f5c7651_del complete
Jul 27 13:41:19 user nova-compute[70914]: INFO nova.compute.manager [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 27 13:41:19 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:41:19 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:41:19 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:41:20 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:41:20 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Took 0.71 seconds to deallocate network for instance.
Jul 27 13:41:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-b71c3184-6138-495b-b1fc-9f559c9f7de8 req-fedd38ee-b40a-4c74-a904-0db7bfa1dbac service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Received event network-vif-deleted-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:20 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:41:20 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:41:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-ca25707e-f94b-4e75-9ac9-7e0689f0540d req-cccc64d9-7635-4322-8dac-4d2f52689f54 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Received event network-vif-plugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ca25707e-f94b-4e75-9ac9-7e0689f0540d req-cccc64d9-7635-4322-8dac-4d2f52689f54 service nova] Acquiring lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ca25707e-f94b-4e75-9ac9-7e0689f0540d req-cccc64d9-7635-4322-8dac-4d2f52689f54 service nova] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ca25707e-f94b-4e75-9ac9-7e0689f0540d req-cccc64d9-7635-4322-8dac-4d2f52689f54 service nova] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-ca25707e-f94b-4e75-9ac9-7e0689f0540d req-cccc64d9-7635-4322-8dac-4d2f52689f54 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] No waiting events found dispatching network-vif-plugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:41:20 user nova-compute[70914]: WARNING nova.compute.manager [req-ca25707e-f94b-4e75-9ac9-7e0689f0540d req-cccc64d9-7635-4322-8dac-4d2f52689f54 service nova] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Received unexpected event network-vif-plugged-07a7bc1b-e5bf-4076-8ac4-4c5ef69c130a for instance with vm_state deleted and task_state None.
Jul 27 13:41:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.695s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:20 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Deleted allocations for instance 60c81594-3bfb-4c2c-ad6a-b9418f5c7651
Jul 27 13:41:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53b557cb-603b-4d2f-986e-8bb86ef3ce23 tempest-ServersNegativeTestJSON-1243391903 tempest-ServersNegativeTestJSON-1243391903-project-member] Lock "60c81594-3bfb-4c2c-ad6a-b9418f5c7651" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.613s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:41:21 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Creating image(s)
Jul 27 13:41:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "/opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "/opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "/opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.130s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk 1073741824" returned: 0 in 0.049s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Checking if we can resize image /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Cannot resize image /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Ensure instance console log exists: /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Start _get_guest_xml network_info=[{"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'ed61adbc-e6f0-4a2c-97bb-ab4a889e5ef3', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdPUNMWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '814e062c-85d1-486b-8c7e-9198fbfc5f63', 'attached_at': '', 'detached_at': '', 'volume_id': '26050a23-0784-4dcc-acaa-3aa249154c33', 'serial': '26050a23-0784-4dcc-acaa-3aa249154c33'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:41:22 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 13:41:22 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'vcpu_model' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdPUNMWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:41:22 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:41:22 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:41:22 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d468857-c125-41ed-b569-eb058b1a43e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:41:22 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[673b0b71-047c-409f-93b4-06450bbec3ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33] added
Jul 27 13:41:22 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9ea27f-d08d-4684-8b92-ce1cc4af112e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21b3621-ae17-45ce-9529-2229df3f9a89]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdPUNMWe {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdPUNMWe" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa26d33d-c0e9-48cf-aff2-825758b7e35d]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RdPUNMWe'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5e065a-7915-486a-b8e3-2d7c1b337607]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b99bf5-4d9f-421a-88ab-737f8e7d5a69]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:22 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:22 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fc7cba-7ce2-427a-9cc5-f0702cfd3527]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260]
Jul 27 13:41:22 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260] successful.
Jul 27 13:41:22 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f28e5c8-74d9-4f1b-8c10-6d7ff92265c8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[39711d18-5e4d-488f-a62f-d1aa8f849f14]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:22 user nova-compute[70914]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:41:22 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:41:22 user nova-compute[70914]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:41:22 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41258f2-9aa6-426d-8249-00a9704250c3]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:41:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdPUNMWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23730353666316533', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730353666316533', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-930458355',display_name='tempest-ServerActionsTestOtherA-server-85355233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-930458355',id=17,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-82o8h0rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=814e062c-85d1-486b-8c7e-9198fbfc5f63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:41:23 user nova-compute[70914]:   <uuid>814e062c-85d1-486b-8c7e-9198fbfc5f63</uuid>
Jul 27 13:41:23 user nova-compute[70914]:   <name>instance-00000011</name>
Jul 27 13:41:23 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:41:23 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:41:23 user nova-compute[70914]:   <metadata>
Jul 27 13:41:23 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:41:23 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:41:23 user nova-compute[70914]:       <nova:name>tempest-ServerActionsTestOtherA-server-85355233</nova:name>
Jul 27 13:41:23 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:41:22</nova:creationTime>
Jul 27 13:41:23 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:41:23 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:41:23 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:41:23 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:41:23 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:41:23 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:41:23 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:41:23 user nova-compute[70914]:       <nova:owner>
Jul 27 13:41:23 user nova-compute[70914]:         <nova:user uuid="252ad07dbf034a09b3be3c05dba67b3f">tempest-ServerActionsTestOtherA-1561010505-project-member</nova:user>
Jul 27 13:41:23 user nova-compute[70914]:         <nova:project uuid="5da684ade5ad4a328eb543f6d6da0ad9">tempest-ServerActionsTestOtherA-1561010505</nova:project>
Jul 27 13:41:23 user nova-compute[70914]:       </nova:owner>
Jul 27 13:41:23 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:41:23 user nova-compute[70914]:       <nova:ports>
Jul 27 13:41:23 user nova-compute[70914]:         <nova:port uuid="31f7f5f5-e982-4083-a3dd-48fd7e526cd5">
Jul 27 13:41:23 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 13:41:23 user nova-compute[70914]:         </nova:port>
Jul 27 13:41:23 user nova-compute[70914]:       </nova:ports>
Jul 27 13:41:23 user nova-compute[70914]:     </nova:instance>
Jul 27 13:41:23 user nova-compute[70914]:   </metadata>
Jul 27 13:41:23 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:41:23 user nova-compute[70914]:     <system>
Jul 27 13:41:23 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:41:23 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:41:23 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:41:23 user nova-compute[70914]:       <entry name="serial">814e062c-85d1-486b-8c7e-9198fbfc5f63</entry>
Jul 27 13:41:23 user nova-compute[70914]:       <entry name="uuid">814e062c-85d1-486b-8c7e-9198fbfc5f63</entry>
Jul 27 13:41:23 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:41:23 user nova-compute[70914]:     </system>
Jul 27 13:41:23 user nova-compute[70914]:   </sysinfo>
Jul 27 13:41:23 user nova-compute[70914]:   <os>
Jul 27 13:41:23 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:41:23 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:41:23 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:41:23 user nova-compute[70914]:   </os>
Jul 27 13:41:23 user nova-compute[70914]:   <features>
Jul 27 13:41:23 user nova-compute[70914]:     <acpi/>
Jul 27 13:41:23 user nova-compute[70914]:     <apic/>
Jul 27 13:41:23 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:41:23 user nova-compute[70914]:   </features>
Jul 27 13:41:23 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:41:23 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:41:23 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:41:23 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:41:23 user nova-compute[70914]:   </clock>
Jul 27 13:41:23 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:41:23 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:41:23 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:41:23 user nova-compute[70914]:   </cpu>
Jul 27 13:41:23 user nova-compute[70914]:   <devices>
Jul 27 13:41:23 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:41:23 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:41:23 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk"/>
Jul 27 13:41:23 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:41:23 user nova-compute[70914]:     </disk>
Jul 27 13:41:23 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:41:23 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:41:23 user nova-compute[70914]:       <source dev="/dev/sdb"/>
Jul 27 13:41:23 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:41:23 user nova-compute[70914]:       <serial>26050a23-0784-4dcc-acaa-3aa249154c33</serial>
Jul 27 13:41:23 user nova-compute[70914]:     </disk>
Jul 27 13:41:23 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:41:23 user nova-compute[70914]:       <mac address="fa:16:3e:f6:64:4a"/>
Jul 27 13:41:23 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:41:23 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:41:23 user nova-compute[70914]:       <target dev="tap31f7f5f5-e9"/>
Jul 27 13:41:23 user nova-compute[70914]:     </interface>
Jul 27 13:41:23 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:41:23 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/console.log" append="off"/>
Jul 27 13:41:23 user nova-compute[70914]:     </serial>
Jul 27 13:41:23 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:41:23 user nova-compute[70914]:     <video>
Jul 27 13:41:23 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:41:23 user nova-compute[70914]:     </video>
Jul 27 13:41:23 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:41:23 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:41:23 user nova-compute[70914]:     </rng>
Jul 27 13:41:23 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:41:23 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:41:23 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:41:23 user nova-compute[70914]:     </memballoon>
Jul 27 13:41:23 user nova-compute[70914]:   </devices>
Jul 27 13:41:23 user nova-compute[70914]: </domain>
Jul 27 13:41:23 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-930458355',display_name='tempest-ServerActionsTestOtherA-server-85355233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-930458355',id=17,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-82o8h0rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=814e062c-85d1-486b-8c7e-9198fbfc5f63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG os_vif [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31f7f5f5-e9, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31f7f5f5-e9, col_values=(('external_ids', {'iface-id': '31f7f5f5-e982-4083-a3dd-48fd7e526cd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:64:4a', 'vm-uuid': '814e062c-85d1-486b-8c7e-9198fbfc5f63'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:41:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:23 user nova-compute[70914]: INFO os_vif [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9')
Jul 27 13:41:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:41:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:41:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No VIF found with MAC fa:16:3e:f6:64:4a, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:41:24 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465269.417234, 38108984-8bd8-49b6-9111-33c084a5a16a => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:41:24 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] VM Stopped (Lifecycle Event)
Jul 27 13:41:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7b36291d-9216-498d-a456-5fc3bbd152b7 None None] [instance: 38108984-8bd8-49b6-9111-33c084a5a16a] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-7f3df982-21ee-45a3-820c-9ae56c1d89f0 req-5d1ab35f-1d04-4957-a194-c63e65fd2a50 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7f3df982-21ee-45a3-820c-9ae56c1d89f0 req-5d1ab35f-1d04-4957-a194-c63e65fd2a50 service nova] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7f3df982-21ee-45a3-820c-9ae56c1d89f0 req-5d1ab35f-1d04-4957-a194-c63e65fd2a50 service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7f3df982-21ee-45a3-820c-9ae56c1d89f0 req-5d1ab35f-1d04-4957-a194-c63e65fd2a50 service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-7f3df982-21ee-45a3-820c-9ae56c1d89f0 req-5d1ab35f-1d04-4957-a194-c63e65fd2a50 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] No waiting events found dispatching network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:41:25 user nova-compute[70914]: WARNING nova.compute.manager [req-7f3df982-21ee-45a3-820c-9ae56c1d89f0 req-5d1ab35f-1d04-4957-a194-c63e65fd2a50 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received unexpected event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 13:41:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465272.064435, 814e062c-85d1-486b-8c7e-9198fbfc5f63 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:41:27 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] VM Stopped (Lifecycle Event)
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a7391cea-9500-45f1-b3df-f2e1d8e088d8 None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465287.5858037, 814e062c-85d1-486b-8c7e-9198fbfc5f63 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:41:27 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] VM Resumed (Lifecycle Event)
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:41:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Instance spawned successfully.
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.compute.manager [req-c3582168-f8e4-46ef-9cc1-0c0cae9734ee req-ceee19de-440d-407b-aab2-fdbc6516cdbc service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c3582168-f8e4-46ef-9cc1-0c0cae9734ee req-ceee19de-440d-407b-aab2-fdbc6516cdbc service nova] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c3582168-f8e4-46ef-9cc1-0c0cae9734ee req-ceee19de-440d-407b-aab2-fdbc6516cdbc service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c3582168-f8e4-46ef-9cc1-0c0cae9734ee req-ceee19de-440d-407b-aab2-fdbc6516cdbc service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.compute.manager [req-c3582168-f8e4-46ef-9cc1-0c0cae9734ee req-ceee19de-440d-407b-aab2-fdbc6516cdbc service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] No waiting events found dispatching network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:41:27 user nova-compute[70914]: WARNING nova.compute.manager [req-c3582168-f8e4-46ef-9cc1-0c0cae9734ee req-ceee19de-440d-407b-aab2-fdbc6516cdbc service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received unexpected event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:41:27 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465287.590857, 814e062c-85d1-486b-8c7e-9198fbfc5f63 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:41:27 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] VM Started (Lifecycle Event)
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:41:27 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 13:41:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70914) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 13:41:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a4326e93-87ac-414f-bbec-9ea71ab4d2ce tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.118s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:34 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465279.100124, 60c81594-3bfb-4c2c-ad6a-b9418f5c7651 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:41:34 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] VM Stopped (Lifecycle Event)
Jul 27 13:41:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-834fa4fc-6978-495a-a585-37dcf62f767c None None] [instance: 60c81594-3bfb-4c2c-ad6a-b9418f5c7651] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:41:37 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:41:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:39 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:41:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:41:40 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:41:40 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:41:40 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:41:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:41:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:41:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:41:44 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:41:44 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:41:44 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7179MB free_disk=25.460407257080078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:41:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:41:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 509e7547-8472-4954-8fc6-a152e9667437 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 10fa8c48-a95a-411f-9de0-aabf19455f57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 30050776-6e41-487a-9ad2-342b18a7b72f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:41:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updating instance_info_cache with network_info: [{"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:41:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:03 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:03 user nova-compute[70914]: INFO nova.compute.manager [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] instance snapshotting
Jul 27 13:42:03 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Beginning live snapshot process
Jul 27 13:42:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json -f qcow2 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json -f qcow2 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:04 user nova-compute[70914]: INFO nova.compute.manager [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Terminating instance
Jul 27 13:42:04 user nova-compute[70914]: DEBUG nova.compute.manager [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json -f qcow2" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.161s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb7fjf2dq/27bda7464b3a460ab26218dd0012590e.delta 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb7fjf2dq/27bda7464b3a460ab26218dd0012590e.delta 1073741824" returned: 0 in 0.050s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:04 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 13:42:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-39eb72da-3592-4475-ad4f-b3b05197f525 req-f121f160-0bc5-484c-85b7-53a3d6d0743b service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-unplugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-39eb72da-3592-4475-ad4f-b3b05197f525 req-f121f160-0bc5-484c-85b7-53a3d6d0743b service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-39eb72da-3592-4475-ad4f-b3b05197f525 req-f121f160-0bc5-484c-85b7-53a3d6d0743b service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-39eb72da-3592-4475-ad4f-b3b05197f525 req-f121f160-0bc5-484c-85b7-53a3d6d0743b service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-39eb72da-3592-4475-ad4f-b3b05197f525 req-f121f160-0bc5-484c-85b7-53a3d6d0743b service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-unplugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-39eb72da-3592-4475-ad4f-b3b05197f525 req-f121f160-0bc5-484c-85b7-53a3d6d0743b service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-unplugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:05 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Instance destroyed successfully.
Jul 27 13:42:05 user nova-compute[70914]: DEBUG nova.objects.instance [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'resources' on Instance uuid bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1253144734',display_name='tempest-AttachVolumeTestJSON-server-1253144734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1253144734',id=6,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATTI1RFyfQ2PRv5NB5cEM2tkF6yPM7cRAOJeCVPdJukiYvV0GqTPHVKc2LLrkmUe7gAf9AX0WCEnPmbS46UKi6r5ob0VnyeUfGZfj+EtT1Nf6CADr6H3u6d7f2/M6ZW3A==',key_name='tempest-keypair-1952109515',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-k0nq37r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:40:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "address": "fa:16:3e:a7:0c:e4", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9e022a-7a", "ovs_interfaceid": "3e9e022a-7a8b-42ed-b88f-2c32b880ee78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG os_vif [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e9e022a-7a, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:42:05 user nova-compute[70914]: INFO os_vif [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:0c:e4,bridge_name='br-int',has_traffic_filtering=True,id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9e022a-7a')
Jul 27 13:42:05 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Deleting instance files /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5_del
Jul 27 13:42:05 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Deletion of /opt/stack/data/nova/instances/bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5_del complete
Jul 27 13:42:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:42:05 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 13:42:05 user nova-compute[70914]: INFO nova.compute.manager [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Took 1.63 seconds to destroy the instance on the hypervisor.
Jul 27 13:42:05 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:42:05 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:42:06 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:42:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb7fjf2dq/27bda7464b3a460ab26218dd0012590e.delta /opt/stack/data/nova/instances/snapshots/tmpb7fjf2dq/27bda7464b3a460ab26218dd0012590e {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb7fjf2dq/27bda7464b3a460ab26218dd0012590e.delta /opt/stack/data/nova/instances/snapshots/tmpb7fjf2dq/27bda7464b3a460ab26218dd0012590e" returned: 0 in 0.387s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Snapshot extracted, beginning image upload
Jul 27 13:42:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-45e5e871-b4e8-41e3-9f69-fc243eae0585 req-c9353652-a6b4-406b-9b24-8ee9289e0dc7 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-45e5e871-b4e8-41e3-9f69-fc243eae0585 req-c9353652-a6b4-406b-9b24-8ee9289e0dc7 service nova] Acquiring lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-45e5e871-b4e8-41e3-9f69-fc243eae0585 req-c9353652-a6b4-406b-9b24-8ee9289e0dc7 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-45e5e871-b4e8-41e3-9f69-fc243eae0585 req-c9353652-a6b4-406b-9b24-8ee9289e0dc7 service nova] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-45e5e871-b4e8-41e3-9f69-fc243eae0585 req-c9353652-a6b4-406b-9b24-8ee9289e0dc7 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] No waiting events found dispatching network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:06 user nova-compute[70914]: WARNING nova.compute.manager [req-45e5e871-b4e8-41e3-9f69-fc243eae0585 req-c9353652-a6b4-406b-9b24-8ee9289e0dc7 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received unexpected event network-vif-plugged-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 for instance with vm_state active and task_state deleting.
Jul 27 13:42:07 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:07 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Took 1.30 seconds to deallocate network for instance.
Jul 27 13:42:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-6f401dc2-d375-4692-bb4c-667029e0fc52 req-466b6f47-3df7-407f-9043-65dec4f5b0a4 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Received event network-vif-deleted-3e9e022a-7a8b-42ed-b88f-2c32b880ee78 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:07 user nova-compute[70914]: INFO nova.compute.manager [req-6f401dc2-d375-4692-bb4c-667029e0fc52 req-466b6f47-3df7-407f-9043-65dec4f5b0a4 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Neutron deleted interface 3e9e022a-7a8b-42ed-b88f-2c32b880ee78; detaching it from the instance and deleting it from the info cache
Jul 27 13:42:07 user nova-compute[70914]: DEBUG nova.network.neutron [req-6f401dc2-d375-4692-bb4c-667029e0fc52 req-466b6f47-3df7-407f-9043-65dec4f5b0a4 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-6f401dc2-d375-4692-bb4c-667029e0fc52 req-466b6f47-3df7-407f-9043-65dec4f5b0a4 service nova] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Detach interface failed, port_id=3e9e022a-7a8b-42ed-b88f-2c32b880ee78, reason: Instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:42:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:07 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:42:07 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:42:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:07 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Deleted allocations for instance bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5
Jul 27 13:42:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-51c9031e-6adb-46a8-bfef-faaf504ab176 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.552s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:08 user nova-compute[70914]: INFO nova.compute.manager [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Terminating instance
Jul 27 13:42:08 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:42:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Snapshot image upload complete
Jul 27 13:42:09 user nova-compute[70914]: INFO nova.compute.manager [None req-b99b66d8-6892-4890-82f7-29955ca0771f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Took 5.38 seconds to snapshot the instance on the hypervisor.
Jul 27 13:42:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-525e38d8-2995-4b99-a722-2efbf4b7a112 req-b0f165da-f1f1-4537-9ff1-55bfe8304fb0 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received event network-vif-unplugged-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-525e38d8-2995-4b99-a722-2efbf4b7a112 req-b0f165da-f1f1-4537-9ff1-55bfe8304fb0 service nova] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-525e38d8-2995-4b99-a722-2efbf4b7a112 req-b0f165da-f1f1-4537-9ff1-55bfe8304fb0 service nova] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-525e38d8-2995-4b99-a722-2efbf4b7a112 req-b0f165da-f1f1-4537-9ff1-55bfe8304fb0 service nova] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-525e38d8-2995-4b99-a722-2efbf4b7a112 req-b0f165da-f1f1-4537-9ff1-55bfe8304fb0 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] No waiting events found dispatching network-vif-unplugged-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-525e38d8-2995-4b99-a722-2efbf4b7a112 req-b0f165da-f1f1-4537-9ff1-55bfe8304fb0 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received event network-vif-unplugged-57f3731c-b1cc-416d-b717-2fdff9bac71c for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:42:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Instance destroyed successfully.
Jul 27 13:42:09 user nova-compute[70914]: DEBUG nova.objects.instance [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lazy-loading 'resources' on Instance uuid 72a9344d-135a-4283-b42e-cf0e5fb4bc75 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-459089625',display_name='tempest-SnapshotDataIntegrityTests-server-459089625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-459089625',id=14,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUQM3ZyZJ5JshAGoRuqLjfF/7Z9EQDhrUC/FrCWK6xAJNGaimfMfFHGtCt91oSyWSPw2EI0TJD/GvwIihwpqJPUnZiTrTOqwzCuPdJhMMzmqmNHTOOJZzJfAZG5ZB40Hg==',key_name='tempest-keypair-1139849949',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b29c9301c3b0454bbe8dcea3be232d26',ramdisk_id='',reservation_id='r-2iuq0gb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1084768390',owner_user_name='tempest-SnapshotDataIntegrityTests-1084768390-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='582160dde2714d8b92aab6f64feeeabd',uuid=72a9344d-135a-4283-b42e-cf0e5fb4bc75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Converting VIF {"id": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "address": "fa:16:3e:a7:1a:64", "network": {"id": "c53867ce-ff16-47f8-8388-ac386c047adc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2067460146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c9301c3b0454bbe8dcea3be232d26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f3731c-b1", "ovs_interfaceid": "57f3731c-b1cc-416d-b717-2fdff9bac71c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=57f3731c-b1cc-416d-b717-2fdff9bac71c,network=Network(c53867ce-ff16-47f8-8388-ac386c047adc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f3731c-b1') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG os_vif [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=57f3731c-b1cc-416d-b717-2fdff9bac71c,network=Network(c53867ce-ff16-47f8-8388-ac386c047adc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f3731c-b1') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57f3731c-b1, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:42:09 user nova-compute[70914]: INFO os_vif [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=57f3731c-b1cc-416d-b717-2fdff9bac71c,network=Network(c53867ce-ff16-47f8-8388-ac386c047adc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f3731c-b1')
Jul 27 13:42:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Deleting instance files /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75_del
Jul 27 13:42:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Deletion of /opt/stack/data/nova/instances/72a9344d-135a-4283-b42e-cf0e5fb4bc75_del complete
Jul 27 13:42:09 user nova-compute[70914]: INFO nova.compute.manager [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 27 13:42:09 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:42:09 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:42:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-c6e1f1af-1084-402f-9afb-a4af98a1cb93 req-d12cafc0-5e64-40e7-bda2-b9546b240da9 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received event network-vif-plugged-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c6e1f1af-1084-402f-9afb-a4af98a1cb93 req-d12cafc0-5e64-40e7-bda2-b9546b240da9 service nova] Acquiring lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c6e1f1af-1084-402f-9afb-a4af98a1cb93 req-d12cafc0-5e64-40e7-bda2-b9546b240da9 service nova] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c6e1f1af-1084-402f-9afb-a4af98a1cb93 req-d12cafc0-5e64-40e7-bda2-b9546b240da9 service nova] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-c6e1f1af-1084-402f-9afb-a4af98a1cb93 req-d12cafc0-5e64-40e7-bda2-b9546b240da9 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] No waiting events found dispatching network-vif-plugged-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:11 user nova-compute[70914]: WARNING nova.compute.manager [req-c6e1f1af-1084-402f-9afb-a4af98a1cb93 req-d12cafc0-5e64-40e7-bda2-b9546b240da9 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received unexpected event network-vif-plugged-57f3731c-b1cc-416d-b717-2fdff9bac71c for instance with vm_state active and task_state deleting.
Jul 27 13:42:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:13 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:13 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Took 3.69 seconds to deallocate network for instance.
Jul 27 13:42:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-d3780855-1b2e-4314-9e93-c2de0b9d0154 req-b57d80d9-2fd3-4f3e-a698-172f078c05e6 service nova] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Received event network-vif-deleted-57f3731c-b1cc-416d-b717-2fdff9bac71c {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:13 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:42:13 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:42:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:14 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Deleted allocations for instance 72a9344d-135a-4283-b42e-cf0e5fb4bc75
Jul 27 13:42:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bae82072-4c3c-41e5-8b19-5a47efee425c tempest-SnapshotDataIntegrityTests-1084768390 tempest-SnapshotDataIntegrityTests-1084768390-project-member] Lock "72a9344d-135a-4283-b42e-cf0e5fb4bc75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.253s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:17 user nova-compute[70914]: INFO nova.compute.manager [None req-ae76f715-6af7-4b3a-ab83-554b9e8c6c1a tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Unrescuing
Jul 27 13:42:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-ae76f715-6af7-4b3a-ab83-554b9e8c6c1a tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:42:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-ae76f715-6af7-4b3a-ab83-554b9e8c6c1a tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquired lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:42:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-ae76f715-6af7-4b3a-ab83-554b9e8c6c1a tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:42:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-ae76f715-6af7-4b3a-ab83-554b9e8c6c1a tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating instance_info_cache with network_info: [{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-ae76f715-6af7-4b3a-ab83-554b9e8c6c1a tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Releasing lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG nova.objects.instance [None req-ae76f715-6af7-4b3a-ab83-554b9e8c6c1a tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'flavor' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-338f017b-9320-40f5-8e7c-400de4045fd7 req-bd5e9259-c433-47c0-a537-2acff6b4f91b service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-unplugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-338f017b-9320-40f5-8e7c-400de4045fd7 req-bd5e9259-c433-47c0-a537-2acff6b4f91b service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-338f017b-9320-40f5-8e7c-400de4045fd7 req-bd5e9259-c433-47c0-a537-2acff6b4f91b service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-338f017b-9320-40f5-8e7c-400de4045fd7 req-bd5e9259-c433-47c0-a537-2acff6b4f91b service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-338f017b-9320-40f5-8e7c-400de4045fd7 req-bd5e9259-c433-47c0-a537-2acff6b4f91b service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-unplugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:18 user nova-compute[70914]: WARNING nova.compute.manager [req-338f017b-9320-40f5-8e7c-400de4045fd7 req-bd5e9259-c433-47c0-a537-2acff6b4f91b service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-unplugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:42:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Instance destroyed successfully.
Jul 27 13:42:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-6adeaaa4-7608-47b4-8576-e45a1e4c4d9b req-04fdb1ec-cb83-42a7-b8b7-1accf221a208 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-changed-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-6adeaaa4-7608-47b4-8576-e45a1e4c4d9b req-04fdb1ec-cb83-42a7-b8b7-1accf221a208 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Refreshing instance network info cache due to event network-changed-7c115254-d063-49fe-b94c-e7a22b8ccb31. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6adeaaa4-7608-47b4-8576-e45a1e4c4d9b req-04fdb1ec-cb83-42a7-b8b7-1accf221a208 service nova] Acquiring lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6adeaaa4-7608-47b4-8576-e45a1e4c4d9b req-04fdb1ec-cb83-42a7-b8b7-1accf221a208 service nova] Acquired lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-6adeaaa4-7608-47b4-8576-e45a1e4c4d9b req-04fdb1ec-cb83-42a7-b8b7-1accf221a208 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Refreshing network info cache for port 7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-6adeaaa4-7608-47b4-8576-e45a1e4c4d9b req-04fdb1ec-cb83-42a7-b8b7-1accf221a208 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updated VIF entry in instance network info cache for port 7c115254-d063-49fe-b94c-e7a22b8ccb31. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-6adeaaa4-7608-47b4-8576-e45a1e4c4d9b req-04fdb1ec-cb83-42a7-b8b7-1accf221a208 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating instance_info_cache with network_info: [{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6adeaaa4-7608-47b4-8576-e45a1e4c4d9b req-04fdb1ec-cb83-42a7-b8b7-1accf221a208 service nova] Releasing lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465325.8128095, bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:42:20 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] VM Stopped (Lifecycle Event)
Jul 27 13:42:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0e024650-818e-4d6d-be2b-712b8e756218 None None] [instance: bc5fb4ff-4ee4-4862-a4b0-01d3313dbac5] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-42ab5152-7496-43b7-8cee-39bfe643a217 req-baf86f39-4ed3-4268-9baf-2e2b748fe96a service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-42ab5152-7496-43b7-8cee-39bfe643a217 req-baf86f39-4ed3-4268-9baf-2e2b748fe96a service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-42ab5152-7496-43b7-8cee-39bfe643a217 req-baf86f39-4ed3-4268-9baf-2e2b748fe96a service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-42ab5152-7496-43b7-8cee-39bfe643a217 req-baf86f39-4ed3-4268-9baf-2e2b748fe96a service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-42ab5152-7496-43b7-8cee-39bfe643a217 req-baf86f39-4ed3-4268-9baf-2e2b748fe96a service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:21 user nova-compute[70914]: WARNING nova.compute.manager [req-42ab5152-7496-43b7-8cee-39bfe643a217 req-baf86f39-4ed3-4268-9baf-2e2b748fe96a service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:42:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-c539c6a6-6dad-47c7-a983-f652c91b8a61 req-358f15a6-3a0d-414a-b767-73fd4753f799 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-changed-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-c539c6a6-6dad-47c7-a983-f652c91b8a61 req-358f15a6-3a0d-414a-b767-73fd4753f799 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Refreshing instance network info cache due to event network-changed-7c115254-d063-49fe-b94c-e7a22b8ccb31. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:42:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c539c6a6-6dad-47c7-a983-f652c91b8a61 req-358f15a6-3a0d-414a-b767-73fd4753f799 service nova] Acquiring lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:42:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c539c6a6-6dad-47c7-a983-f652c91b8a61 req-358f15a6-3a0d-414a-b767-73fd4753f799 service nova] Acquired lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:42:22 user nova-compute[70914]: DEBUG nova.network.neutron [req-c539c6a6-6dad-47c7-a983-f652c91b8a61 req-358f15a6-3a0d-414a-b767-73fd4753f799 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Refreshing network info cache for port 7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.network.neutron [req-c539c6a6-6dad-47c7-a983-f652c91b8a61 req-358f15a6-3a0d-414a-b767-73fd4753f799 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updated VIF entry in instance network info cache for port 7c115254-d063-49fe-b94c-e7a22b8ccb31. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.network.neutron [req-c539c6a6-6dad-47c7-a983-f652c91b8a61 req-358f15a6-3a0d-414a-b767-73fd4753f799 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating instance_info_cache with network_info: [{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c539c6a6-6dad-47c7-a983-f652c91b8a61 req-358f15a6-3a0d-414a-b767-73fd4753f799 service nova] Releasing lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:23 user nova-compute[70914]: WARNING nova.compute.manager [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:23 user nova-compute[70914]: WARNING nova.compute.manager [req-dada6dc8-e5ae-49fa-aab7-5cf4b960d68a req-6f2cb3bc-4363-4e32-a403-09b903cf5702 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for 509e7547-8472-4954-8fc6-a152e9667437 due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465343.1768696, 509e7547-8472-4954-8fc6-a152e9667437 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:42:23 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] VM Resumed (Lifecycle Event)
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-ae76f715-6af7-4b3a-ab83-554b9e8c6c1a tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:42:23 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465343.1777263, 509e7547-8472-4954-8fc6-a152e9667437 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:42:23 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] VM Started (Lifecycle Event)
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:42:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:24 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465329.680346, 72a9344d-135a-4283-b42e-cf0e5fb4bc75 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:42:24 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] VM Stopped (Lifecycle Event)
Jul 27 13:42:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1c1a3a75-07f4-47c2-aa90-de76cf29c75f None None] [instance: 72a9344d-135a-4283-b42e-cf0e5fb4bc75] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:42:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:25 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:42:25 user nova-compute[70914]: INFO nova.compute.claims [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Claim successful on node user
Jul 27 13:42:25 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:42:25 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG nova.network.neutron [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:42:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:42:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:42:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Creating image(s)
Jul 27 13:42:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "/opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "/opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "/opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "c1bc30a9f3cf1d0209308240f19a74a08dbaafa7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "c1bc30a9f3cf1d0209308240f19a74a08dbaafa7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7.part --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG nova.policy [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '340b2ab1e12b4e0491b86f3eb2596cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45941da6cb4b3a8c7394cc649e62e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7.part --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG nova.virt.images [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] 34c687af-4258-46da-8a45-5258a18fd9d1 was qcow2, converting to raw {{(pid=70914) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:42:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7.part /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7.converted {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7.part /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7.converted" returned: 0 in 0.221s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7.converted --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7.converted --force-share --output=json" returned: 0 in 0.153s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "c1bc30a9f3cf1d0209308240f19a74a08dbaafa7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7 --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "c1bc30a9f3cf1d0209308240f19a74a08dbaafa7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "c1bc30a9f3cf1d0209308240f19a74a08dbaafa7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG nova.network.neutron [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Successfully created port: 4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7 --force-share --output=json" returned: 0 in 0.162s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7,backing_fmt=raw /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7,backing_fmt=raw /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk 1073741824" returned: 0 in 0.062s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "c1bc30a9f3cf1d0209308240f19a74a08dbaafa7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7 --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:42:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:28 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Cannot resize image /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:42:28 user nova-compute[70914]: DEBUG nova.objects.instance [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'migration_context' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:42:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Ensure instance console log exists: /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:42:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.neutron [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Successfully updated port: 4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquired lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.neutron [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-d7aada94-33b6-41c8-9e4e-45ed6c600705 req-323a8595-1e99-4404-8134-625d008c72c7 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-changed-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-d7aada94-33b6-41c8-9e4e-45ed6c600705 req-323a8595-1e99-4404-8134-625d008c72c7 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Refreshing instance network info cache due to event network-changed-4252cbc5-88bf-446c-abdb-46c174a0afa6. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d7aada94-33b6-41c8-9e4e-45ed6c600705 req-323a8595-1e99-4404-8134-625d008c72c7 service nova] Acquiring lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.neutron [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.neutron [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updating instance_info_cache with network_info: [{"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Releasing lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.compute.manager [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Instance network_info: |[{"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d7aada94-33b6-41c8-9e4e-45ed6c600705 req-323a8595-1e99-4404-8134-625d008c72c7 service nova] Acquired lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.neutron [req-d7aada94-33b6-41c8-9e4e-45ed6c600705 req-323a8595-1e99-4404-8134-625d008c72c7 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Refreshing network info cache for port 4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Start _get_guest_xml network_info=[{"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:42:22Z,direct_url=<?>,disk_format='qcow2',id=34c687af-4258-46da-8a45-5258a18fd9d1,min_disk=0,min_ram=0,name='tempest-scenario-img--1531553716',owner='0b45941da6cb4b3a8c7394cc649e62e5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:42:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '34c687af-4258-46da-8a45-5258a18fd9d1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:42:29 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:42:29 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:42:22Z,direct_url=<?>,disk_format='qcow2',id=34c687af-4258-46da-8a45-5258a18fd9d1,min_disk=0,min_ram=0,name='tempest-scenario-img--1531553716',owner='0b45941da6cb4b3a8c7394cc649e62e5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:42:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-948322511',display_name='tempest-TestMinimumBasicScenario-server-948322511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-948322511',id=23,image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKgwFRMqg++F6VMttGQOMCdPQ6K0qJzfmdZXVdMWuv9ZYlvkJksIbxDMMfuJdggMi0iYxooQuba5bDy2He7DNtQCGSRS8ITcsjdGfcwf3G6wCYY0GYn+GWFDcsPlWjFug==',key_name='tempest-TestMinimumBasicScenario-2060879644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45941da6cb4b3a8c7394cc649e62e5',ramdisk_id='',reservation_id='r-377gj72q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-779682044',owner_user_name='tempest-TestMinimumBasicScenario-779682044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:42:26Z,user_data=None,user_id='340b2ab1e12b4e0491b86f3eb2596cd1',uuid=0371b280-fc39-4cbd-b496-ba78fea4e856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converting VIF {"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.objects.instance [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'pci_devices' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:42:29 user nova-compute[70914]:   <uuid>0371b280-fc39-4cbd-b496-ba78fea4e856</uuid>
Jul 27 13:42:29 user nova-compute[70914]:   <name>instance-00000017</name>
Jul 27 13:42:29 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:42:29 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:42:29 user nova-compute[70914]:   <metadata>
Jul 27 13:42:29 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:42:29 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:42:29 user nova-compute[70914]:       <nova:name>tempest-TestMinimumBasicScenario-server-948322511</nova:name>
Jul 27 13:42:29 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:42:29</nova:creationTime>
Jul 27 13:42:29 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:42:29 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:42:29 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:42:29 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:42:29 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:42:29 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:42:29 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:42:29 user nova-compute[70914]:       <nova:owner>
Jul 27 13:42:29 user nova-compute[70914]:         <nova:user uuid="340b2ab1e12b4e0491b86f3eb2596cd1">tempest-TestMinimumBasicScenario-779682044-project-member</nova:user>
Jul 27 13:42:29 user nova-compute[70914]:         <nova:project uuid="0b45941da6cb4b3a8c7394cc649e62e5">tempest-TestMinimumBasicScenario-779682044</nova:project>
Jul 27 13:42:29 user nova-compute[70914]:       </nova:owner>
Jul 27 13:42:29 user nova-compute[70914]:       <nova:root type="image" uuid="34c687af-4258-46da-8a45-5258a18fd9d1"/>
Jul 27 13:42:29 user nova-compute[70914]:       <nova:ports>
Jul 27 13:42:29 user nova-compute[70914]:         <nova:port uuid="4252cbc5-88bf-446c-abdb-46c174a0afa6">
Jul 27 13:42:29 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 13:42:29 user nova-compute[70914]:         </nova:port>
Jul 27 13:42:29 user nova-compute[70914]:       </nova:ports>
Jul 27 13:42:29 user nova-compute[70914]:     </nova:instance>
Jul 27 13:42:29 user nova-compute[70914]:   </metadata>
Jul 27 13:42:29 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:42:29 user nova-compute[70914]:     <system>
Jul 27 13:42:29 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:42:29 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:42:29 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:42:29 user nova-compute[70914]:       <entry name="serial">0371b280-fc39-4cbd-b496-ba78fea4e856</entry>
Jul 27 13:42:29 user nova-compute[70914]:       <entry name="uuid">0371b280-fc39-4cbd-b496-ba78fea4e856</entry>
Jul 27 13:42:29 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:42:29 user nova-compute[70914]:     </system>
Jul 27 13:42:29 user nova-compute[70914]:   </sysinfo>
Jul 27 13:42:29 user nova-compute[70914]:   <os>
Jul 27 13:42:29 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:42:29 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:42:29 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:42:29 user nova-compute[70914]:   </os>
Jul 27 13:42:29 user nova-compute[70914]:   <features>
Jul 27 13:42:29 user nova-compute[70914]:     <acpi/>
Jul 27 13:42:29 user nova-compute[70914]:     <apic/>
Jul 27 13:42:29 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:42:29 user nova-compute[70914]:   </features>
Jul 27 13:42:29 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:42:29 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:42:29 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:42:29 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:42:29 user nova-compute[70914]:   </clock>
Jul 27 13:42:29 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:42:29 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:42:29 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:42:29 user nova-compute[70914]:   </cpu>
Jul 27 13:42:29 user nova-compute[70914]:   <devices>
Jul 27 13:42:29 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:42:29 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:42:29 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk"/>
Jul 27 13:42:29 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:42:29 user nova-compute[70914]:     </disk>
Jul 27 13:42:29 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:42:29 user nova-compute[70914]:       <mac address="fa:16:3e:ff:b5:23"/>
Jul 27 13:42:29 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:42:29 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:42:29 user nova-compute[70914]:       <target dev="tap4252cbc5-88"/>
Jul 27 13:42:29 user nova-compute[70914]:     </interface>
Jul 27 13:42:29 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:42:29 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/console.log" append="off"/>
Jul 27 13:42:29 user nova-compute[70914]:     </serial>
Jul 27 13:42:29 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:42:29 user nova-compute[70914]:     <video>
Jul 27 13:42:29 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:42:29 user nova-compute[70914]:     </video>
Jul 27 13:42:29 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:42:29 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:42:29 user nova-compute[70914]:     </rng>
Jul 27 13:42:29 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:42:29 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:42:29 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:42:29 user nova-compute[70914]:     </memballoon>
Jul 27 13:42:29 user nova-compute[70914]:   </devices>
Jul 27 13:42:29 user nova-compute[70914]: </domain>
Jul 27 13:42:29 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-948322511',display_name='tempest-TestMinimumBasicScenario-server-948322511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-948322511',id=23,image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKgwFRMqg++F6VMttGQOMCdPQ6K0qJzfmdZXVdMWuv9ZYlvkJksIbxDMMfuJdggMi0iYxooQuba5bDy2He7DNtQCGSRS8ITcsjdGfcwf3G6wCYY0GYn+GWFDcsPlWjFug==',key_name='tempest-TestMinimumBasicScenario-2060879644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45941da6cb4b3a8c7394cc649e62e5',ramdisk_id='',reservation_id='r-377gj72q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-779682044',owner_user_name='tempest-TestMinimumBasicScenario-779682044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:42:26Z,user_data=None,user_id='340b2ab1e12b4e0491b86f3eb2596cd1',uuid=0371b280-fc39-4cbd-b496-ba78fea4e856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converting VIF {"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG os_vif [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4252cbc5-88, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4252cbc5-88, col_values=(('external_ids', {'iface-id': '4252cbc5-88bf-446c-abdb-46c174a0afa6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:b5:23', 'vm-uuid': '0371b280-fc39-4cbd-b496-ba78fea4e856'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:29 user nova-compute[70914]: INFO os_vif [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88')
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] No VIF found with MAC fa:16:3e:ff:b5:23, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.neutron [req-d7aada94-33b6-41c8-9e4e-45ed6c600705 req-323a8595-1e99-4404-8134-625d008c72c7 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updated VIF entry in instance network info cache for port 4252cbc5-88bf-446c-abdb-46c174a0afa6. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG nova.network.neutron [req-d7aada94-33b6-41c8-9e4e-45ed6c600705 req-323a8595-1e99-4404-8134-625d008c72c7 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updating instance_info_cache with network_info: [{"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d7aada94-33b6-41c8-9e4e-45ed6c600705 req-323a8595-1e99-4404-8134-625d008c72c7 service nova] Releasing lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:42:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-bbc03330-0399-4a05-bdb1-0240d3442631 req-6d0b47e7-b9af-4721-a2d3-dc9586a0d65c service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bbc03330-0399-4a05-bdb1-0240d3442631 req-6d0b47e7-b9af-4721-a2d3-dc9586a0d65c service nova] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bbc03330-0399-4a05-bdb1-0240d3442631 req-6d0b47e7-b9af-4721-a2d3-dc9586a0d65c service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bbc03330-0399-4a05-bdb1-0240d3442631 req-6d0b47e7-b9af-4721-a2d3-dc9586a0d65c service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-bbc03330-0399-4a05-bdb1-0240d3442631 req-6d0b47e7-b9af-4721-a2d3-dc9586a0d65c service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] No waiting events found dispatching network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:31 user nova-compute[70914]: WARNING nova.compute.manager [req-bbc03330-0399-4a05-bdb1-0240d3442631 req-6d0b47e7-b9af-4721-a2d3-dc9586a0d65c service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received unexpected event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 for instance with vm_state building and task_state spawning.
Jul 27 13:42:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:42:31 user nova-compute[70914]: INFO nova.compute.claims [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Claim successful on node user
Jul 27 13:42:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:42:32 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:42:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG nova.policy [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce42c397b5d44afd9c12497b2bf40fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c132beeb2d43b1b568da4492f2ffc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:42:32 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Creating image(s)
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "/opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "/opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.169s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.165s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk 1073741824" returned: 0 in 0.064s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.189s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Cannot resize image /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'migration_context' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Ensure instance console log exists: /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465353.3118138, 0371b280-fc39-4cbd-b496-ba78fea4e856 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:42:33 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] VM Resumed (Lifecycle Event)
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:42:33 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Instance spawned successfully.
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:33 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465353.3135564, 0371b280-fc39-4cbd-b496-ba78fea4e856 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:42:33 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] VM Started (Lifecycle Event)
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-c88bf999-1c82-4db1-811e-677332ed8375 req-fca6851e-00fc-49fc-957b-a29f99915fbd service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c88bf999-1c82-4db1-811e-677332ed8375 req-fca6851e-00fc-49fc-957b-a29f99915fbd service nova] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c88bf999-1c82-4db1-811e-677332ed8375 req-fca6851e-00fc-49fc-957b-a29f99915fbd service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c88bf999-1c82-4db1-811e-677332ed8375 req-fca6851e-00fc-49fc-957b-a29f99915fbd service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-c88bf999-1c82-4db1-811e-677332ed8375 req-fca6851e-00fc-49fc-957b-a29f99915fbd service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] No waiting events found dispatching network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:33 user nova-compute[70914]: WARNING nova.compute.manager [req-c88bf999-1c82-4db1-811e-677332ed8375 req-fca6851e-00fc-49fc-957b-a29f99915fbd service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received unexpected event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 for instance with vm_state building and task_state spawning.
Jul 27 13:42:33 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:42:33 user nova-compute[70914]: INFO nova.compute.manager [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Took 7.18 seconds to spawn the instance on the hypervisor.
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:33 user nova-compute[70914]: INFO nova.compute.manager [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Took 7.98 seconds to build instance.
Jul 27 13:42:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-53f4595e-868d-4cad-8940-f437d21f236d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.159s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:33 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Successfully created port: ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:42:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:34 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 13:42:34 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] There are 0 instances to clean {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 13:42:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Successfully updated port: ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquired lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-85a8e297-9e31-4edd-8fc4-29c4441f4d04 req-4f2529fb-005c-4c01-8a30-bea20862f588 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-changed-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-85a8e297-9e31-4edd-8fc4-29c4441f4d04 req-4f2529fb-005c-4c01-8a30-bea20862f588 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Refreshing instance network info cache due to event network-changed-ef1f245c-0a46-4cd8-8851-c93741559d97. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-85a8e297-9e31-4edd-8fc4-29c4441f4d04 req-4f2529fb-005c-4c01-8a30-bea20862f588 service nova] Acquiring lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updating instance_info_cache with network_info: [{"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Releasing lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Instance network_info: |[{"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-85a8e297-9e31-4edd-8fc4-29c4441f4d04 req-4f2529fb-005c-4c01-8a30-bea20862f588 service nova] Acquired lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.network.neutron [req-85a8e297-9e31-4edd-8fc4-29c4441f4d04 req-4f2529fb-005c-4c01-8a30-bea20862f588 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Refreshing network info cache for port ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Start _get_guest_xml network_info=[{"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:42:36 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:42:36 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1002806692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1002806692',id=24,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOp7kA5GsVKxK7vy6xGG3HUQDmGrBeuuo/lroY6vdSLHo0PMS4wZK7mlc0LUUIgDVuztVrn2KZy3eXeePOKG+URgPP4gtVe8S6ZdIaDay/2vu1i1r/qxxoyr11tBYjQurw==',key_name='tempest-keypair-1688577340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-2uukqca4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:42:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=4e856bc3-ce45-4307-af2b-33c82ed1eccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:42:36 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:42:37 user nova-compute[70914]:   <uuid>4e856bc3-ce45-4307-af2b-33c82ed1eccc</uuid>
Jul 27 13:42:37 user nova-compute[70914]:   <name>instance-00000018</name>
Jul 27 13:42:37 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:42:37 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:42:37 user nova-compute[70914]:   <metadata>
Jul 27 13:42:37 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:42:37 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:42:37 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1002806692</nova:name>
Jul 27 13:42:37 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:42:36</nova:creationTime>
Jul 27 13:42:37 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:42:37 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:42:37 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:42:37 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:42:37 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:42:37 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:42:37 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:42:37 user nova-compute[70914]:       <nova:owner>
Jul 27 13:42:37 user nova-compute[70914]:         <nova:user uuid="ce42c397b5d44afd9c12497b2bf40fb5">tempest-AttachVolumeShelveTestJSON-90363656-project-member</nova:user>
Jul 27 13:42:37 user nova-compute[70914]:         <nova:project uuid="30c132beeb2d43b1b568da4492f2ffc9">tempest-AttachVolumeShelveTestJSON-90363656</nova:project>
Jul 27 13:42:37 user nova-compute[70914]:       </nova:owner>
Jul 27 13:42:37 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:42:37 user nova-compute[70914]:       <nova:ports>
Jul 27 13:42:37 user nova-compute[70914]:         <nova:port uuid="ef1f245c-0a46-4cd8-8851-c93741559d97">
Jul 27 13:42:37 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 13:42:37 user nova-compute[70914]:         </nova:port>
Jul 27 13:42:37 user nova-compute[70914]:       </nova:ports>
Jul 27 13:42:37 user nova-compute[70914]:     </nova:instance>
Jul 27 13:42:37 user nova-compute[70914]:   </metadata>
Jul 27 13:42:37 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:42:37 user nova-compute[70914]:     <system>
Jul 27 13:42:37 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:42:37 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:42:37 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:42:37 user nova-compute[70914]:       <entry name="serial">4e856bc3-ce45-4307-af2b-33c82ed1eccc</entry>
Jul 27 13:42:37 user nova-compute[70914]:       <entry name="uuid">4e856bc3-ce45-4307-af2b-33c82ed1eccc</entry>
Jul 27 13:42:37 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:42:37 user nova-compute[70914]:     </system>
Jul 27 13:42:37 user nova-compute[70914]:   </sysinfo>
Jul 27 13:42:37 user nova-compute[70914]:   <os>
Jul 27 13:42:37 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:42:37 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:42:37 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:42:37 user nova-compute[70914]:   </os>
Jul 27 13:42:37 user nova-compute[70914]:   <features>
Jul 27 13:42:37 user nova-compute[70914]:     <acpi/>
Jul 27 13:42:37 user nova-compute[70914]:     <apic/>
Jul 27 13:42:37 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:42:37 user nova-compute[70914]:   </features>
Jul 27 13:42:37 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:42:37 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:42:37 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:42:37 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:42:37 user nova-compute[70914]:   </clock>
Jul 27 13:42:37 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:42:37 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:42:37 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:42:37 user nova-compute[70914]:   </cpu>
Jul 27 13:42:37 user nova-compute[70914]:   <devices>
Jul 27 13:42:37 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:42:37 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:42:37 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk"/>
Jul 27 13:42:37 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:42:37 user nova-compute[70914]:     </disk>
Jul 27 13:42:37 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:42:37 user nova-compute[70914]:       <mac address="fa:16:3e:7e:b8:3f"/>
Jul 27 13:42:37 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:42:37 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:42:37 user nova-compute[70914]:       <target dev="tapef1f245c-0a"/>
Jul 27 13:42:37 user nova-compute[70914]:     </interface>
Jul 27 13:42:37 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:42:37 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/console.log" append="off"/>
Jul 27 13:42:37 user nova-compute[70914]:     </serial>
Jul 27 13:42:37 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:42:37 user nova-compute[70914]:     <video>
Jul 27 13:42:37 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:42:37 user nova-compute[70914]:     </video>
Jul 27 13:42:37 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:42:37 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:42:37 user nova-compute[70914]:     </rng>
Jul 27 13:42:37 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:42:37 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:42:37 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:42:37 user nova-compute[70914]:     </memballoon>
Jul 27 13:42:37 user nova-compute[70914]:   </devices>
Jul 27 13:42:37 user nova-compute[70914]: </domain>
Jul 27 13:42:37 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1002806692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1002806692',id=24,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOp7kA5GsVKxK7vy6xGG3HUQDmGrBeuuo/lroY6vdSLHo0PMS4wZK7mlc0LUUIgDVuztVrn2KZy3eXeePOKG+URgPP4gtVe8S6ZdIaDay/2vu1i1r/qxxoyr11tBYjQurw==',key_name='tempest-keypair-1688577340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-2uukqca4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:42:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=4e856bc3-ce45-4307-af2b-33c82ed1eccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG os_vif [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef1f245c-0a, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef1f245c-0a, col_values=(('external_ids', {'iface-id': 'ef1f245c-0a46-4cd8-8851-c93741559d97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:b8:3f', 'vm-uuid': '4e856bc3-ce45-4307-af2b-33c82ed1eccc'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:37 user nova-compute[70914]: INFO os_vif [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a')
Jul 27 13:42:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] No VIF found with MAC fa:16:3e:7e:b8:3f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG nova.network.neutron [req-85a8e297-9e31-4edd-8fc4-29c4441f4d04 req-4f2529fb-005c-4c01-8a30-bea20862f588 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updated VIF entry in instance network info cache for port ef1f245c-0a46-4cd8-8851-c93741559d97. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG nova.network.neutron [req-85a8e297-9e31-4edd-8fc4-29c4441f4d04 req-4f2529fb-005c-4c01-8a30-bea20862f588 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updating instance_info_cache with network_info: [{"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-85a8e297-9e31-4edd-8fc4-29c4441f4d04 req-4f2529fb-005c-4c01-8a30-bea20862f588 service nova] Releasing lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:42:38 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-fdba35ab-63a3-4ecc-9f28-05d26f3a2ce7 req-086a13f6-c290-46fe-9052-d4d753b6232e service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fdba35ab-63a3-4ecc-9f28-05d26f3a2ce7 req-086a13f6-c290-46fe-9052-d4d753b6232e service nova] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fdba35ab-63a3-4ecc-9f28-05d26f3a2ce7 req-086a13f6-c290-46fe-9052-d4d753b6232e service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fdba35ab-63a3-4ecc-9f28-05d26f3a2ce7 req-086a13f6-c290-46fe-9052-d4d753b6232e service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-fdba35ab-63a3-4ecc-9f28-05d26f3a2ce7 req-086a13f6-c290-46fe-9052-d4d753b6232e service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] No waiting events found dispatching network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:39 user nova-compute[70914]: WARNING nova.compute.manager [req-fdba35ab-63a3-4ecc-9f28-05d26f3a2ce7 req-086a13f6-c290-46fe-9052-d4d753b6232e service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received unexpected event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 for instance with vm_state building and task_state spawning.
Jul 27 13:42:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-960d9f6c-aafe-4d13-98c8-19e593f63fcc req-674f6cb7-666a-4d78-976c-b69d37614e77 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-changed-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-960d9f6c-aafe-4d13-98c8-19e593f63fcc req-674f6cb7-666a-4d78-976c-b69d37614e77 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Refreshing instance network info cache due to event network-changed-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-960d9f6c-aafe-4d13-98c8-19e593f63fcc req-674f6cb7-666a-4d78-976c-b69d37614e77 service nova] Acquiring lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-960d9f6c-aafe-4d13-98c8-19e593f63fcc req-674f6cb7-666a-4d78-976c-b69d37614e77 service nova] Acquired lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG nova.network.neutron [req-960d9f6c-aafe-4d13-98c8-19e593f63fcc req-674f6cb7-666a-4d78-976c-b69d37614e77 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Refreshing network info cache for port bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.objects.instance [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'flavor' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465361.3185956, 4e856bc3-ce45-4307-af2b-33c82ed1eccc => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:42:41 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] VM Resumed (Lifecycle Event)
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-9e0fedfe-2c2f-4ac3-a599-ea1f79239c9f req-cf49ea34-b7ea-4ef0-adc7-25893d8a6814 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9e0fedfe-2c2f-4ac3-a599-ea1f79239c9f req-cf49ea34-b7ea-4ef0-adc7-25893d8a6814 service nova] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9e0fedfe-2c2f-4ac3-a599-ea1f79239c9f req-cf49ea34-b7ea-4ef0-adc7-25893d8a6814 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9e0fedfe-2c2f-4ac3-a599-ea1f79239c9f req-cf49ea34-b7ea-4ef0-adc7-25893d8a6814 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-9e0fedfe-2c2f-4ac3-a599-ea1f79239c9f req-cf49ea34-b7ea-4ef0-adc7-25893d8a6814 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] No waiting events found dispatching network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:41 user nova-compute[70914]: WARNING nova.compute.manager [req-9e0fedfe-2c2f-4ac3-a599-ea1f79239c9f req-cf49ea34-b7ea-4ef0-adc7-25893d8a6814 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received unexpected event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 for instance with vm_state building and task_state spawning.
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:41 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Instance spawned successfully.
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:42:41 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465361.3188603, 4e856bc3-ce45-4307-af2b-33c82ed1eccc => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:42:41 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] VM Started (Lifecycle Event)
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:42:41 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: INFO nova.compute.manager [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Took 9.17 seconds to spawn the instance on the hypervisor.
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:41 user nova-compute[70914]: INFO nova.compute.manager [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Attaching volume d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 to /dev/vdb
Jul 27 13:42:41 user nova-compute[70914]: DEBUG os_brick.utils [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcc8fb3-5adc-4c5b-b58a-ccf86a88402e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: INFO nova.compute.manager [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Took 10.12 seconds to build instance.
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb9fedb-0401-4060-a0c1-eb7999b01b23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5e2cddec-b0a6-4798-a2a0-4fd30a02435a tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.247s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f73c37-60fb-4335-9992-f72b20c52ee5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76f31aa-effe-4e3c-919f-52b5fe1389a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:42:41 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:42:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda65da3-b339-4148-93de-ebf0dab21dc4]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG os_brick.utils [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] <== get_connector_properties: return (226ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:42:41 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updating existing volume attachment record: a92ae295-bc43-4ece-aaa1-58be9a4fb791 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG nova.network.neutron [req-960d9f6c-aafe-4d13-98c8-19e593f63fcc req-674f6cb7-666a-4d78-976c-b69d37614e77 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updated VIF entry in instance network info cache for port bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG nova.network.neutron [req-960d9f6c-aafe-4d13-98c8-19e593f63fcc req-674f6cb7-666a-4d78-976c-b69d37614e77 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updating instance_info_cache with network_info: [{"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-960d9f6c-aafe-4d13-98c8-19e593f63fcc req-674f6cb7-666a-4d78-976c-b69d37614e77 service nova] Releasing lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:42:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:45 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:42:45 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7319MB free_disk=25.364330291748047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 509e7547-8472-4954-8fc6-a152e9667437 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 10fa8c48-a95a-411f-9de0-aabf19455f57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 30050776-6e41-487a-9ad2-342b18a7b72f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0371b280-fc39-4cbd-b496-ba78fea4e856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances with incomplete migration  {{(pid=70914) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 13:42:46 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:46 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:42:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:42:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:42:46 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:42:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:47 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating instance_info_cache with network_info: [{"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-509e7547-8472-4954-8fc6-a152e9667437" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:42:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:42:47 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:47 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:47 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:42:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdxtnsAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:42:49 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:42:49 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:42:49 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8d45a4-6334-4e53-af87-db595da77746]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:42:49 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41743b5-0f93-4b20-a1a4-f1a3c8f91e26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174] added
Jul 27 13:42:49 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa79269-ce29-4693-8747-3c9dee7edff1]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[be90dd22-e6a1-4d5f-bfd2-fad27d4e7c98]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdxtnsAR {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdxtnsAR" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f951ae-dda7-4ae3-8a87-da161e5087fd]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KdxtnsAR'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bad7703-391d-45e9-b142-76476edb66df]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cd4e5e-34a3-4eda-9e62-2d42de4c08de]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:42:49 user nova-compute[70914]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:42:49 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:42:49 user nova-compute[70914]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:42:49 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:42:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbd367b-03be-4b7a-a2b0-83ed55745df2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174, portal: 172.16.0.220,3260]
Jul 27 13:42:50 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174, portal: 172.16.0.220,3260] successful.
Jul 27 13:42:50 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[28856f88-ec52-433c-b36d-656054530312]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[284a8186-ab44-41d1-bf83-f9730c92179b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:42:50 user nova-compute[70914]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:42:50 user nova-compute[70914]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:42:50 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:42:50 user nova-compute[70914]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:42:50 user nova-compute[70914]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:42:50 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[84196c3b-315b-4024-b12a-5f593f25d6aa]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:42:50 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdxtnsAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:42:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:42:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26236626434346434', 'path': '/dev/sdd'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:42:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236626434346434', 'path': '/dev/sdd'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:42:51 user nova-compute[70914]: DEBUG nova.objects.instance [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'flavor' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:42:51 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:42:51 user nova-compute[70914]:   <source dev="/dev/sdd"/>
Jul 27 13:42:51 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:42:51 user nova-compute[70914]:   <serial>d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174</serial>
Jul 27 13:42:51 user nova-compute[70914]: </disk>
Jul 27 13:42:51 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:42:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:42:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:42:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No VIF found with MAC fa:16:3e:88:40:9d, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:42:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-985f5d87-bfdb-4427-942e-57b8cf9ec9c0 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.138s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:52 user nova-compute[70914]: INFO nova.compute.manager [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Detaching volume c36b85f7-f21b-40fb-a7f8-34d88db9b4ba
Jul 27 13:42:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:52 user nova-compute[70914]: INFO nova.virt.block_device [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Attempting to driver detach volume c36b85f7-f21b-40fb-a7f8-34d88db9b4ba from mountpoint /dev/vdb
Jul 27 13:42:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Attempting to detach device vdb from instance 509e7547-8472-4954-8fc6-a152e9667437 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:42:52 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:42:52 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 13:42:52 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:42:52 user nova-compute[70914]:   <serial>c36b85f7-f21b-40fb-a7f8-34d88db9b4ba</serial>
Jul 27 13:42:52 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:42:52 user nova-compute[70914]: </disk>
Jul 27 13:42:52 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:42:52 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Successfully detached device vdb from instance 509e7547-8472-4954-8fc6-a152e9667437 from the persistent domain config.
Jul 27 13:42:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 509e7547-8472-4954-8fc6-a152e9667437 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:42:52 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:42:52 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 13:42:52 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:42:52 user nova-compute[70914]:   <serial>c36b85f7-f21b-40fb-a7f8-34d88db9b4ba</serial>
Jul 27 13:42:52 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:42:52 user nova-compute[70914]: </disk>
Jul 27 13:42:52 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465372.676183, 509e7547-8472-4954-8fc6-a152e9667437 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:42:52 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Successfully detached device vdb from instance 509e7547-8472-4954-8fc6-a152e9667437 from the live domain config.
Jul 27 13:42:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKJPxEus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:42:52 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[412c3651-6355-4d9b-9573-366d2f2ec24f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:42:52 user nova-compute[70914]: No targets found.
Jul 27 13:42:52 user nova-compute[70914]: iSNS:
Jul 27 13:42:52 user nova-compute[70914]: No targets found.
Jul 27 13:42:52 user nova-compute[70914]: STATIC:
Jul 27 13:42:52 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba
Jul 27 13:42:52 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:42:52 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:42:52 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174
Jul 27 13:42:52 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:42:52 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:42:52 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33
Jul 27 13:42:52 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:42:52 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:42:52 user nova-compute[70914]: FIRMWARE:
Jul 27 13:42:52 user nova-compute[70914]: No targets found.
Jul 27 13:42:52 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:42:52 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:42:52 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[091c4bec-bb52-407f-8995-ff1941916d0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4bb7db-2fb6-4b4d-a0ae-aff96890f4f1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:42:52 user nova-compute[70914]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:42:52 user nova-compute[70914]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:42:52 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba (non-flash)
Jul 27 13:42:52 user nova-compute[70914]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:42:52 user nova-compute[70914]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:42:52 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c1819e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba'): ({'sdc'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Removing single pathed devices sdc {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[292b8674-d7ed-4611-a3e3-0cfaf88db2a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a446f00-311d-44c7-b021-3bfe1c1bac05]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Flushing IO for device /dev/sdc {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f45995a-8611-428c-80d3-bacad4d34b95]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a0b2f-04dc-449c-886f-6f7efb892c89]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e8002e-9ed7-4e9e-915c-41a686b4ccbf]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5ee791-9819-4abf-9762-943f2c08393b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba, portal: 172.16.0.220,3260]
Jul 27 13:42:53 user nova-compute[70914]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba, portal: 172.16.0.220,3260] successful.
Jul 27 13:42:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c36b85f7-f21b-40fb-a7f8-34d88db9b4ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bd553f-163c-4d10-ab7c-defaa9db0c70]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] <== disconnect_volume: return (359ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:42:53 user nova-compute[70914]: INFO nova.compute.manager [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Rescuing
Jul 27 13:42:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquired lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG nova.objects.instance [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'flavor' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-af36f739-6f12-4957-b0df-23def0c82adc tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.783s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updating instance_info_cache with network_info: [{"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Releasing lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:54 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Instance destroyed successfully.
Jul 27 13:42:54 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Attempting rescue
Jul 27 13:42:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70914) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Instance directory exists: not creating {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 13:42:54 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Creating image(s)
Jul 27 13:42:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'trusted_certs' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-d1c74058-3326-4d3d-873a-ae5ccdcfe4f4 req-95c09b9a-b609-4d49-a685-aa20bdc719ef service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-unplugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d1c74058-3326-4d3d-873a-ae5ccdcfe4f4 req-95c09b9a-b609-4d49-a685-aa20bdc719ef service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d1c74058-3326-4d3d-873a-ae5ccdcfe4f4 req-95c09b9a-b609-4d49-a685-aa20bdc719ef service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d1c74058-3326-4d3d-873a-ae5ccdcfe4f4 req-95c09b9a-b609-4d49-a685-aa20bdc719ef service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-d1c74058-3326-4d3d-873a-ae5ccdcfe4f4 req-95c09b9a-b609-4d49-a685-aa20bdc719ef service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-unplugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:55 user nova-compute[70914]: WARNING nova.compute.manager [req-d1c74058-3326-4d3d-873a-ae5ccdcfe4f4 req-95c09b9a-b609-4d49-a685-aa20bdc719ef service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-unplugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state active and task_state rescuing.
Jul 27 13:42:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue" returned: 0 in 0.062s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'migration_context' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Start _get_guest_xml network_info=[{"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "vif_mac": "fa:16:3e:88:40:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'resources' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'numa_topology' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:55 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:42:55 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:40:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1493132680',display_name='tempest-ServerRescueNegativeTestJSON-server-1493132680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1493132680',id=21,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4wmNCkvYQYQ0qqix7wjwraQUsjHfZUo2ooBlM3iiRvi9NS0tf/RJ3lGNtR1r32zT+z7zkJqc3A8Zl6Yst1/6kaDIzOgs0nZKK5GNuqF6wrVURh+o6c7Be54NVRq1bOuA==',key_name='tempest-keypair-1352200146',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:40:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-ndqp4fiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d92b0b34814e75a7709e09e357be07',uuid=30050776-6e41-487a-9ad2-342b18a7b72f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "vif_mac": "fa:16:3e:88:40:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "vif_mac": "fa:16:3e:88:40:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:40:9d,bridge_name='br-int',has_traffic_filtering=True,id=bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb7b48a-92') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'pci_devices' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:42:55 user nova-compute[70914]:   <uuid>30050776-6e41-487a-9ad2-342b18a7b72f</uuid>
Jul 27 13:42:55 user nova-compute[70914]:   <name>instance-00000015</name>
Jul 27 13:42:55 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:42:55 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:42:55 user nova-compute[70914]:   <metadata>
Jul 27 13:42:55 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:42:55 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:42:55 user nova-compute[70914]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1493132680</nova:name>
Jul 27 13:42:55 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:42:55</nova:creationTime>
Jul 27 13:42:55 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:42:55 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:42:55 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:42:55 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:42:55 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:42:55 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:42:55 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:42:55 user nova-compute[70914]:       <nova:owner>
Jul 27 13:42:55 user nova-compute[70914]:         <nova:user uuid="a0d92b0b34814e75a7709e09e357be07">tempest-ServerRescueNegativeTestJSON-1275773337-project-member</nova:user>
Jul 27 13:42:55 user nova-compute[70914]:         <nova:project uuid="097b177edc7249f798bca2c39a33394d">tempest-ServerRescueNegativeTestJSON-1275773337</nova:project>
Jul 27 13:42:55 user nova-compute[70914]:       </nova:owner>
Jul 27 13:42:55 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:42:55 user nova-compute[70914]:       <nova:ports>
Jul 27 13:42:55 user nova-compute[70914]:         <nova:port uuid="bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b">
Jul 27 13:42:55 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 13:42:55 user nova-compute[70914]:         </nova:port>
Jul 27 13:42:55 user nova-compute[70914]:       </nova:ports>
Jul 27 13:42:55 user nova-compute[70914]:     </nova:instance>
Jul 27 13:42:55 user nova-compute[70914]:   </metadata>
Jul 27 13:42:55 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:42:55 user nova-compute[70914]:     <system>
Jul 27 13:42:55 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:42:55 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:42:55 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:42:55 user nova-compute[70914]:       <entry name="serial">30050776-6e41-487a-9ad2-342b18a7b72f</entry>
Jul 27 13:42:55 user nova-compute[70914]:       <entry name="uuid">30050776-6e41-487a-9ad2-342b18a7b72f</entry>
Jul 27 13:42:55 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:42:55 user nova-compute[70914]:     </system>
Jul 27 13:42:55 user nova-compute[70914]:   </sysinfo>
Jul 27 13:42:55 user nova-compute[70914]:   <os>
Jul 27 13:42:55 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:42:55 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:42:55 user nova-compute[70914]:   </os>
Jul 27 13:42:55 user nova-compute[70914]:   <features>
Jul 27 13:42:55 user nova-compute[70914]:     <acpi/>
Jul 27 13:42:55 user nova-compute[70914]:     <apic/>
Jul 27 13:42:55 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:42:55 user nova-compute[70914]:   </features>
Jul 27 13:42:55 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:42:55 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:42:55 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:42:55 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:42:55 user nova-compute[70914]:   </clock>
Jul 27 13:42:55 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:42:55 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:42:55 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:42:55 user nova-compute[70914]:   </cpu>
Jul 27 13:42:55 user nova-compute[70914]:   <devices>
Jul 27 13:42:55 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:42:55 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:42:55 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue"/>
Jul 27 13:42:55 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:42:55 user nova-compute[70914]:     </disk>
Jul 27 13:42:55 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:42:55 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:42:55 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk"/>
Jul 27 13:42:55 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:42:55 user nova-compute[70914]:     </disk>
Jul 27 13:42:55 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:42:55 user nova-compute[70914]:       <mac address="fa:16:3e:88:40:9d"/>
Jul 27 13:42:55 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:42:55 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:42:55 user nova-compute[70914]:       <target dev="tapbfb7b48a-92"/>
Jul 27 13:42:55 user nova-compute[70914]:     </interface>
Jul 27 13:42:55 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:42:55 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/console.log" append="off"/>
Jul 27 13:42:55 user nova-compute[70914]:     </serial>
Jul 27 13:42:55 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:42:55 user nova-compute[70914]:     <video>
Jul 27 13:42:55 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:42:55 user nova-compute[70914]:     </video>
Jul 27 13:42:55 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:42:55 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:42:55 user nova-compute[70914]:     </rng>
Jul 27 13:42:55 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:42:55 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:42:55 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:42:55 user nova-compute[70914]:     </memballoon>
Jul 27 13:42:55 user nova-compute[70914]:   </devices>
Jul 27 13:42:55 user nova-compute[70914]: </domain>
Jul 27 13:42:55 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:42:55 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Instance destroyed successfully.
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:42:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] No VIF found with MAC fa:16:3e:88:40:9d, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:42:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-cc2eb2a7-4f4a-4a24-a8d1-3780b798250d req-e2d38ad0-ff1a-468e-9216-0b53c2f27a0c service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cc2eb2a7-4f4a-4a24-a8d1-3780b798250d req-e2d38ad0-ff1a-468e-9216-0b53c2f27a0c service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cc2eb2a7-4f4a-4a24-a8d1-3780b798250d req-e2d38ad0-ff1a-468e-9216-0b53c2f27a0c service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cc2eb2a7-4f4a-4a24-a8d1-3780b798250d req-e2d38ad0-ff1a-468e-9216-0b53c2f27a0c service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-cc2eb2a7-4f4a-4a24-a8d1-3780b798250d req-e2d38ad0-ff1a-468e-9216-0b53c2f27a0c service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:57 user nova-compute[70914]: WARNING nova.compute.manager [req-cc2eb2a7-4f4a-4a24-a8d1-3780b798250d req-e2d38ad0-ff1a-468e-9216-0b53c2f27a0c service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state active and task_state rescuing.
Jul 27 13:42:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:58 user nova-compute[70914]: INFO nova.compute.manager [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Terminating instance
Jul 27 13:42:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:58 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Instance destroyed successfully.
Jul 27 13:42:58 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lazy-loading 'resources' on Instance uuid 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1390022186',display_name='tempest-VolumesAdminNegativeTest-server-1390022186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1390022186',id=22,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61774ce82df2478186c9bbed654b8c4d',ramdisk_id='',reservation_id='r-ojlr901a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1597280425',owner_user_name='tempest-VolumesAdminNegativeTest-1597280425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:41:06Z,user_data=None,user_id='93a3be9b082b4facadeff78db34d2519',uuid=4fd926d9-5cc3-4e14-83cc-f19ab8b84c31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "address": "fa:16:3e:e5:8d:a8", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a721ac6-a5", "ovs_interfaceid": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converting VIF {"id": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "address": "fa:16:3e:e5:8d:a8", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a721ac6-a5", "ovs_interfaceid": "0a721ac6-a5cf-497f-b49c-684ebc9eff7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a721ac6-a5cf-497f-b49c-684ebc9eff7d,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a721ac6-a5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG os_vif [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a721ac6-a5cf-497f-b49c-684ebc9eff7d,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a721ac6-a5') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a721ac6-a5, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:58 user nova-compute[70914]: INFO os_vif [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a721ac6-a5cf-497f-b49c-684ebc9eff7d,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a721ac6-a5')
Jul 27 13:42:58 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Deleting instance files /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31_del
Jul 27 13:42:58 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Deletion of /opt/stack/data/nova/instances/4fd926d9-5cc3-4e14-83cc-f19ab8b84c31_del complete
Jul 27 13:42:58 user nova-compute[70914]: INFO nova.compute.manager [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Took 0.71 seconds to destroy the instance on the hypervisor.
Jul 27 13:42:58 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:42:58 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:59 user nova-compute[70914]: WARNING nova.compute.manager [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state active and task_state rescuing.
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:42:59 user nova-compute[70914]: WARNING nova.compute.manager [req-7a0d8ef2-26bf-4a77-b0b3-e46fe5d93906 req-ecfc727b-85a0-4073-8e1d-df8f82eaf795 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state active and task_state rescuing.
Jul 27 13:42:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for 30050776-6e41-487a-9ad2-342b18a7b72f due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465379.5895982, 30050776-6e41-487a-9ad2-342b18a7b72f => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:42:59 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] VM Resumed (Lifecycle Event)
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5ec417af-c839-4e92-b7c8-f206ed5c7c96 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:42:59 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465379.5951443, 30050776-6e41-487a-9ad2-342b18a7b72f => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:42:59 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] VM Started (Lifecycle Event)
Jul 27 13:42:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:42:59 user nova-compute[70914]: INFO nova.compute.claims [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Claim successful on node user
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Refreshing inventories for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Updating ProviderTree inventory for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Refreshing aggregate associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, aggregates: None {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 13:42:59 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Refreshing trait associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:00 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Took 1.22 seconds to deallocate network for instance.
Jul 27 13:43:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.919s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.504s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:43:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:43:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG nova.policy [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e9e3e0bd86140ada9edb906a16e4784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b9d12319d046088ca51fc23be9bb21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:43:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Creating image(s)
Jul 27 13:43:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "/opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "/opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "/opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.186s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.583s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:01 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Deleted allocations for instance 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.171s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk 1073741824" returned: 0 in 0.075s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Received event network-vif-unplugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] Acquiring lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] No waiting events found dispatching network-vif-unplugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:01 user nova-compute[70914]: WARNING nova.compute.manager [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Received unexpected event network-vif-unplugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d for instance with vm_state deleted and task_state None.
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Received event network-vif-plugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] Acquiring lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] No waiting events found dispatching network-vif-plugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:01 user nova-compute[70914]: WARNING nova.compute.manager [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Received unexpected event network-vif-plugged-0a721ac6-a5cf-497f-b49c-684ebc9eff7d for instance with vm_state deleted and task_state None.
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-4070319c-29a6-4287-953d-2daa7aa7b681 req-aad74a6a-f4cf-4440-93bc-0b2af0f9d020 service nova] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Received event network-vif-deleted-0a721ac6-a5cf-497f-b49c-684ebc9eff7d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c74e58f8-1ae0-46b2-b478-ab7e059f0621 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "4fd926d9-5cc3-4e14-83cc-f19ab8b84c31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.347s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Successfully created port: 4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.174s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Cannot resize image /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.objects.instance [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'migration_context' on Instance uuid 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Ensure instance console log exists: /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Successfully updated port: 4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "refresh_cache-8897428a-7e38-49ed-9013-df0d2160196e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquired lock "refresh_cache-8897428a-7e38-49ed-9013-df0d2160196e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Updating instance_info_cache with network_info: [{"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Releasing lock "refresh_cache-8897428a-7e38-49ed-9013-df0d2160196e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Instance network_info: |[{"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Start _get_guest_xml network_info=[{"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:43:02 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:43:02 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-506633269',display_name='tempest-AttachVolumeTestJSON-server-506633269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-506633269',id=25,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONLzy2VZHMJUnbb9oBSFj6OZy7pKFpC1QAVtth//OfJfC46sNk/5V+y6PGAJ93cW9gfz4KqtuhUvIA9DY+ZehZLXpr22OtFLPNmuuE6d2CFpu1HrC48UeEFXkM4PfG9tg==',key_name='tempest-keypair-991942898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-ao2lzolk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=8897428a-7e38-49ed-9013-df0d2160196e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=4024f41b-83a0-42dd-9c21-71e5461c023f,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4024f41b-83') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.objects.instance [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'pci_devices' on Instance uuid 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:43:02 user nova-compute[70914]:   <uuid>8897428a-7e38-49ed-9013-df0d2160196e</uuid>
Jul 27 13:43:02 user nova-compute[70914]:   <name>instance-00000019</name>
Jul 27 13:43:02 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:43:02 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:43:02 user nova-compute[70914]:   <metadata>
Jul 27 13:43:02 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:43:02 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:43:02 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeTestJSON-server-506633269</nova:name>
Jul 27 13:43:02 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:43:02</nova:creationTime>
Jul 27 13:43:02 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:43:02 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:43:02 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:43:02 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:43:02 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:43:02 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:43:02 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:43:02 user nova-compute[70914]:       <nova:owner>
Jul 27 13:43:02 user nova-compute[70914]:         <nova:user uuid="7e9e3e0bd86140ada9edb906a16e4784">tempest-AttachVolumeTestJSON-366868791-project-member</nova:user>
Jul 27 13:43:02 user nova-compute[70914]:         <nova:project uuid="b0b9d12319d046088ca51fc23be9bb21">tempest-AttachVolumeTestJSON-366868791</nova:project>
Jul 27 13:43:02 user nova-compute[70914]:       </nova:owner>
Jul 27 13:43:02 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:43:02 user nova-compute[70914]:       <nova:ports>
Jul 27 13:43:02 user nova-compute[70914]:         <nova:port uuid="4024f41b-83a0-42dd-9c21-71e5461c023f">
Jul 27 13:43:02 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 13:43:02 user nova-compute[70914]:         </nova:port>
Jul 27 13:43:02 user nova-compute[70914]:       </nova:ports>
Jul 27 13:43:02 user nova-compute[70914]:     </nova:instance>
Jul 27 13:43:02 user nova-compute[70914]:   </metadata>
Jul 27 13:43:02 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:43:02 user nova-compute[70914]:     <system>
Jul 27 13:43:02 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:43:02 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:43:02 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:43:02 user nova-compute[70914]:       <entry name="serial">8897428a-7e38-49ed-9013-df0d2160196e</entry>
Jul 27 13:43:02 user nova-compute[70914]:       <entry name="uuid">8897428a-7e38-49ed-9013-df0d2160196e</entry>
Jul 27 13:43:02 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:43:02 user nova-compute[70914]:     </system>
Jul 27 13:43:02 user nova-compute[70914]:   </sysinfo>
Jul 27 13:43:02 user nova-compute[70914]:   <os>
Jul 27 13:43:02 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:43:02 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:43:02 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:43:02 user nova-compute[70914]:   </os>
Jul 27 13:43:02 user nova-compute[70914]:   <features>
Jul 27 13:43:02 user nova-compute[70914]:     <acpi/>
Jul 27 13:43:02 user nova-compute[70914]:     <apic/>
Jul 27 13:43:02 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:43:02 user nova-compute[70914]:   </features>
Jul 27 13:43:02 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:43:02 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:43:02 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:43:02 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:43:02 user nova-compute[70914]:   </clock>
Jul 27 13:43:02 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:43:02 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:43:02 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:43:02 user nova-compute[70914]:   </cpu>
Jul 27 13:43:02 user nova-compute[70914]:   <devices>
Jul 27 13:43:02 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:43:02 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:43:02 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk"/>
Jul 27 13:43:02 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:43:02 user nova-compute[70914]:     </disk>
Jul 27 13:43:02 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:43:02 user nova-compute[70914]:       <mac address="fa:16:3e:fb:2e:9f"/>
Jul 27 13:43:02 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:43:02 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:43:02 user nova-compute[70914]:       <target dev="tap4024f41b-83"/>
Jul 27 13:43:02 user nova-compute[70914]:     </interface>
Jul 27 13:43:02 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:43:02 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/console.log" append="off"/>
Jul 27 13:43:02 user nova-compute[70914]:     </serial>
Jul 27 13:43:02 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:43:02 user nova-compute[70914]:     <video>
Jul 27 13:43:02 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:43:02 user nova-compute[70914]:     </video>
Jul 27 13:43:02 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:43:02 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:43:02 user nova-compute[70914]:     </rng>
Jul 27 13:43:02 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:43:02 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:43:02 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:43:02 user nova-compute[70914]:     </memballoon>
Jul 27 13:43:02 user nova-compute[70914]:   </devices>
Jul 27 13:43:02 user nova-compute[70914]: </domain>
Jul 27 13:43:02 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-506633269',display_name='tempest-AttachVolumeTestJSON-server-506633269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-506633269',id=25,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONLzy2VZHMJUnbb9oBSFj6OZy7pKFpC1QAVtth//OfJfC46sNk/5V+y6PGAJ93cW9gfz4KqtuhUvIA9DY+ZehZLXpr22OtFLPNmuuE6d2CFpu1HrC48UeEFXkM4PfG9tg==',key_name='tempest-keypair-991942898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-ao2lzolk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=8897428a-7e38-49ed-9013-df0d2160196e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=4024f41b-83a0-42dd-9c21-71e5461c023f,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4024f41b-83') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG os_vif [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=4024f41b-83a0-42dd-9c21-71e5461c023f,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4024f41b-83') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4024f41b-83, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4024f41b-83, col_values=(('external_ids', {'iface-id': '4024f41b-83a0-42dd-9c21-71e5461c023f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:2e:9f', 'vm-uuid': '8897428a-7e38-49ed-9013-df0d2160196e'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:43:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:02 user nova-compute[70914]: INFO os_vif [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=4024f41b-83a0-42dd-9c21-71e5461c023f,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4024f41b-83')
Jul 27 13:43:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:43:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No VIF found with MAC fa:16:3e:fb:2e:9f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:43:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-d621ebf4-8f53-4bd3-a6e8-f978f1e8c5e9 req-b6a86394-a111-4a13-8ca0-149018ef1789 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received event network-changed-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-d621ebf4-8f53-4bd3-a6e8-f978f1e8c5e9 req-b6a86394-a111-4a13-8ca0-149018ef1789 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Refreshing instance network info cache due to event network-changed-4024f41b-83a0-42dd-9c21-71e5461c023f. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:43:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d621ebf4-8f53-4bd3-a6e8-f978f1e8c5e9 req-b6a86394-a111-4a13-8ca0-149018ef1789 service nova] Acquiring lock "refresh_cache-8897428a-7e38-49ed-9013-df0d2160196e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:43:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d621ebf4-8f53-4bd3-a6e8-f978f1e8c5e9 req-b6a86394-a111-4a13-8ca0-149018ef1789 service nova] Acquired lock "refresh_cache-8897428a-7e38-49ed-9013-df0d2160196e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:43:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-d621ebf4-8f53-4bd3-a6e8-f978f1e8c5e9 req-b6a86394-a111-4a13-8ca0-149018ef1789 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Refreshing network info cache for port 4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:43:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-d621ebf4-8f53-4bd3-a6e8-f978f1e8c5e9 req-b6a86394-a111-4a13-8ca0-149018ef1789 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Updated VIF entry in instance network info cache for port 4024f41b-83a0-42dd-9c21-71e5461c023f. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:43:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-d621ebf4-8f53-4bd3-a6e8-f978f1e8c5e9 req-b6a86394-a111-4a13-8ca0-149018ef1789 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Updating instance_info_cache with network_info: [{"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d621ebf4-8f53-4bd3-a6e8-f978f1e8c5e9 req-b6a86394-a111-4a13-8ca0-149018ef1789 service nova] Releasing lock "refresh_cache-8897428a-7e38-49ed-9013-df0d2160196e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "617c1690-feaf-4158-be9c-bb53cb74d31f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:04 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:43:04 user nova-compute[70914]: INFO nova.compute.claims [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Claim successful on node user
Jul 27 13:43:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:43:05 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.policy [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52e4c423609f4481b1634fbaca3e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca794885b0f49cf84038cd7c3edf9ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:43:05 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Creating image(s)
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "/opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "/opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "/opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received event network-vif-plugged-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] Lock "8897428a-7e38-49ed-9013-df0d2160196e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] Lock "8897428a-7e38-49ed-9013-df0d2160196e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] No waiting events found dispatching network-vif-plugged-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:05 user nova-compute[70914]: WARNING nova.compute.manager [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received unexpected event network-vif-plugged-4024f41b-83a0-42dd-9c21-71e5461c023f for instance with vm_state building and task_state spawning.
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received event network-vif-plugged-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] Lock "8897428a-7e38-49ed-9013-df0d2160196e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] Lock "8897428a-7e38-49ed-9013-df0d2160196e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] No waiting events found dispatching network-vif-plugged-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:05 user nova-compute[70914]: WARNING nova.compute.manager [req-5532da3c-24eb-45e7-a179-09f69d96a0da req-0ce755de-3b64-4c03-985a-050ef9fb38c2 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received unexpected event network-vif-plugged-4024f41b-83a0-42dd-9c21-71e5461c023f for instance with vm_state building and task_state spawning.
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.163s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk 1073741824" returned: 0 in 0.060s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.185s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Successfully created port: 1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Cannot resize image /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.objects.instance [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lazy-loading 'migration_context' on Instance uuid 617c1690-feaf-4158-be9c-bb53cb74d31f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Ensure instance console log exists: /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465386.7443295, 8897428a-7e38-49ed-9013-df0d2160196e => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:43:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] VM Resumed (Lifecycle Event)
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:43:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Instance spawned successfully.
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465386.7491994, 8897428a-7e38-49ed-9013-df0d2160196e => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:43:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] VM Started (Lifecycle Event)
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:43:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:43:06 user nova-compute[70914]: INFO nova.compute.manager [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Took 5.98 seconds to spawn the instance on the hypervisor.
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Successfully updated port: 1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:43:06 user nova-compute[70914]: INFO nova.compute.manager [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Took 7.49 seconds to build instance.
Jul 27 13:43:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "refresh_cache-617c1690-feaf-4158-be9c-bb53cb74d31f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquired lock "refresh_cache-617c1690-feaf-4158-be9c-bb53cb74d31f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:43:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49ea71ad-bb67-43df-b39d-8477f9384a45 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.653s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Updating instance_info_cache with network_info: [{"id": "1d5a6186-4f09-4030-b47f-d13117b7310a", "address": "fa:16:3e:0d:4a:61", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d5a6186-4f", "ovs_interfaceid": "1d5a6186-4f09-4030-b47f-d13117b7310a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Releasing lock "refresh_cache-617c1690-feaf-4158-be9c-bb53cb74d31f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Instance network_info: |[{"id": "1d5a6186-4f09-4030-b47f-d13117b7310a", "address": "fa:16:3e:0d:4a:61", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d5a6186-4f", "ovs_interfaceid": "1d5a6186-4f09-4030-b47f-d13117b7310a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Start _get_guest_xml network_info=[{"id": "1d5a6186-4f09-4030-b47f-d13117b7310a", "address": "fa:16:3e:0d:4a:61", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d5a6186-4f", "ovs_interfaceid": "1d5a6186-4f09-4030-b47f-d13117b7310a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:43:07 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:43:07 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-203608085',display_name='tempest-VolumesActionsTest-instance-203608085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-203608085',id=26,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bca794885b0f49cf84038cd7c3edf9ee',ramdisk_id='',reservation_id='r-5jg9les4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1110307362',owner_user_name='tempest-VolumesActionsTest-1110307362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:43:05Z,user_data=None,user_id='52e4c423609f4481b1634fbaca3e7ddb',uuid=617c1690-feaf-4158-be9c-bb53cb74d31f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d5a6186-4f09-4030-b47f-d13117b7310a", "address": "fa:16:3e:0d:4a:61", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d5a6186-4f", "ovs_interfaceid": "1d5a6186-4f09-4030-b47f-d13117b7310a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converting VIF {"id": "1d5a6186-4f09-4030-b47f-d13117b7310a", "address": "fa:16:3e:0d:4a:61", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d5a6186-4f", "ovs_interfaceid": "1d5a6186-4f09-4030-b47f-d13117b7310a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4a:61,bridge_name='br-int',has_traffic_filtering=True,id=1d5a6186-4f09-4030-b47f-d13117b7310a,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d5a6186-4f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lazy-loading 'pci_devices' on Instance uuid 617c1690-feaf-4158-be9c-bb53cb74d31f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:43:07 user nova-compute[70914]:   <uuid>617c1690-feaf-4158-be9c-bb53cb74d31f</uuid>
Jul 27 13:43:07 user nova-compute[70914]:   <name>instance-0000001a</name>
Jul 27 13:43:07 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:43:07 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:43:07 user nova-compute[70914]:   <metadata>
Jul 27 13:43:07 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:43:07 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:43:07 user nova-compute[70914]:       <nova:name>tempest-VolumesActionsTest-instance-203608085</nova:name>
Jul 27 13:43:07 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:43:07</nova:creationTime>
Jul 27 13:43:07 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:43:07 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:43:07 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:43:07 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:43:07 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:43:07 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:43:07 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:43:07 user nova-compute[70914]:       <nova:owner>
Jul 27 13:43:07 user nova-compute[70914]:         <nova:user uuid="52e4c423609f4481b1634fbaca3e7ddb">tempest-VolumesActionsTest-1110307362-project-member</nova:user>
Jul 27 13:43:07 user nova-compute[70914]:         <nova:project uuid="bca794885b0f49cf84038cd7c3edf9ee">tempest-VolumesActionsTest-1110307362</nova:project>
Jul 27 13:43:07 user nova-compute[70914]:       </nova:owner>
Jul 27 13:43:07 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:43:07 user nova-compute[70914]:       <nova:ports>
Jul 27 13:43:07 user nova-compute[70914]:         <nova:port uuid="1d5a6186-4f09-4030-b47f-d13117b7310a">
Jul 27 13:43:07 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 13:43:07 user nova-compute[70914]:         </nova:port>
Jul 27 13:43:07 user nova-compute[70914]:       </nova:ports>
Jul 27 13:43:07 user nova-compute[70914]:     </nova:instance>
Jul 27 13:43:07 user nova-compute[70914]:   </metadata>
Jul 27 13:43:07 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:43:07 user nova-compute[70914]:     <system>
Jul 27 13:43:07 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:43:07 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:43:07 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:43:07 user nova-compute[70914]:       <entry name="serial">617c1690-feaf-4158-be9c-bb53cb74d31f</entry>
Jul 27 13:43:07 user nova-compute[70914]:       <entry name="uuid">617c1690-feaf-4158-be9c-bb53cb74d31f</entry>
Jul 27 13:43:07 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:43:07 user nova-compute[70914]:     </system>
Jul 27 13:43:07 user nova-compute[70914]:   </sysinfo>
Jul 27 13:43:07 user nova-compute[70914]:   <os>
Jul 27 13:43:07 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:43:07 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:43:07 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:43:07 user nova-compute[70914]:   </os>
Jul 27 13:43:07 user nova-compute[70914]:   <features>
Jul 27 13:43:07 user nova-compute[70914]:     <acpi/>
Jul 27 13:43:07 user nova-compute[70914]:     <apic/>
Jul 27 13:43:07 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:43:07 user nova-compute[70914]:   </features>
Jul 27 13:43:07 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:43:07 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:43:07 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:43:07 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:43:07 user nova-compute[70914]:   </clock>
Jul 27 13:43:07 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:43:07 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:43:07 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:43:07 user nova-compute[70914]:   </cpu>
Jul 27 13:43:07 user nova-compute[70914]:   <devices>
Jul 27 13:43:07 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:43:07 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:43:07 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk"/>
Jul 27 13:43:07 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:43:07 user nova-compute[70914]:     </disk>
Jul 27 13:43:07 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:43:07 user nova-compute[70914]:       <mac address="fa:16:3e:0d:4a:61"/>
Jul 27 13:43:07 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:43:07 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:43:07 user nova-compute[70914]:       <target dev="tap1d5a6186-4f"/>
Jul 27 13:43:07 user nova-compute[70914]:     </interface>
Jul 27 13:43:07 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:43:07 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/console.log" append="off"/>
Jul 27 13:43:07 user nova-compute[70914]:     </serial>
Jul 27 13:43:07 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:43:07 user nova-compute[70914]:     <video>
Jul 27 13:43:07 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:43:07 user nova-compute[70914]:     </video>
Jul 27 13:43:07 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:43:07 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:43:07 user nova-compute[70914]:     </rng>
Jul 27 13:43:07 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:43:07 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:43:07 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:43:07 user nova-compute[70914]:     </memballoon>
Jul 27 13:43:07 user nova-compute[70914]:   </devices>
Jul 27 13:43:07 user nova-compute[70914]: </domain>
Jul 27 13:43:07 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-203608085',display_name='tempest-VolumesActionsTest-instance-203608085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-203608085',id=26,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bca794885b0f49cf84038cd7c3edf9ee',ramdisk_id='',reservation_id='r-5jg9les4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1110307362',owner_user_name='tempest-VolumesActionsTest-1110307362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:43:05Z,user_data=None,user_id='52e4c423609f4481b1634fbaca3e7ddb',uuid=617c1690-feaf-4158-be9c-bb53cb74d31f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d5a6186-4f09-4030-b47f-d13117b7310a", "address": "fa:16:3e:0d:4a:61", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d5a6186-4f", "ovs_interfaceid": "1d5a6186-4f09-4030-b47f-d13117b7310a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converting VIF {"id": "1d5a6186-4f09-4030-b47f-d13117b7310a", "address": "fa:16:3e:0d:4a:61", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d5a6186-4f", "ovs_interfaceid": "1d5a6186-4f09-4030-b47f-d13117b7310a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4a:61,bridge_name='br-int',has_traffic_filtering=True,id=1d5a6186-4f09-4030-b47f-d13117b7310a,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d5a6186-4f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG os_vif [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4a:61,bridge_name='br-int',has_traffic_filtering=True,id=1d5a6186-4f09-4030-b47f-d13117b7310a,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d5a6186-4f') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d5a6186-4f, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d5a6186-4f, col_values=(('external_ids', {'iface-id': '1d5a6186-4f09-4030-b47f-d13117b7310a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:4a:61', 'vm-uuid': '617c1690-feaf-4158-be9c-bb53cb74d31f'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:07 user nova-compute[70914]: INFO os_vif [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4a:61,bridge_name='br-int',has_traffic_filtering=True,id=1d5a6186-4f09-4030-b47f-d13117b7310a,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d5a6186-4f')
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] No VIF found with MAC fa:16:3e:0d:4a:61, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-127d00e7-f121-47a6-ac51-4a1e9767c66e req-b1d46be1-1669-4ba3-9110-93c61420b9f6 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Received event network-changed-1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-127d00e7-f121-47a6-ac51-4a1e9767c66e req-b1d46be1-1669-4ba3-9110-93c61420b9f6 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Refreshing instance network info cache due to event network-changed-1d5a6186-4f09-4030-b47f-d13117b7310a. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-127d00e7-f121-47a6-ac51-4a1e9767c66e req-b1d46be1-1669-4ba3-9110-93c61420b9f6 service nova] Acquiring lock "refresh_cache-617c1690-feaf-4158-be9c-bb53cb74d31f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-127d00e7-f121-47a6-ac51-4a1e9767c66e req-b1d46be1-1669-4ba3-9110-93c61420b9f6 service nova] Acquired lock "refresh_cache-617c1690-feaf-4158-be9c-bb53cb74d31f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:43:07 user nova-compute[70914]: DEBUG nova.network.neutron [req-127d00e7-f121-47a6-ac51-4a1e9767c66e req-b1d46be1-1669-4ba3-9110-93c61420b9f6 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Refreshing network info cache for port 1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:43:08 user nova-compute[70914]: DEBUG nova.network.neutron [req-127d00e7-f121-47a6-ac51-4a1e9767c66e req-b1d46be1-1669-4ba3-9110-93c61420b9f6 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Updated VIF entry in instance network info cache for port 1d5a6186-4f09-4030-b47f-d13117b7310a. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:43:08 user nova-compute[70914]: DEBUG nova.network.neutron [req-127d00e7-f121-47a6-ac51-4a1e9767c66e req-b1d46be1-1669-4ba3-9110-93c61420b9f6 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Updating instance_info_cache with network_info: [{"id": "1d5a6186-4f09-4030-b47f-d13117b7310a", "address": "fa:16:3e:0d:4a:61", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d5a6186-4f", "ovs_interfaceid": "1d5a6186-4f09-4030-b47f-d13117b7310a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-127d00e7-f121-47a6-ac51-4a1e9767c66e req-b1d46be1-1669-4ba3-9110-93c61420b9f6 service nova] Releasing lock "refresh_cache-617c1690-feaf-4158-be9c-bb53cb74d31f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:43:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-5f01df87-73c8-47b5-ac3b-f2756883be27 req-e35c83b7-019c-4fd4-928b-589758a0a3ba service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Received event network-vif-plugged-1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5f01df87-73c8-47b5-ac3b-f2756883be27 req-e35c83b7-019c-4fd4-928b-589758a0a3ba service nova] Acquiring lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5f01df87-73c8-47b5-ac3b-f2756883be27 req-e35c83b7-019c-4fd4-928b-589758a0a3ba service nova] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5f01df87-73c8-47b5-ac3b-f2756883be27 req-e35c83b7-019c-4fd4-928b-589758a0a3ba service nova] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-5f01df87-73c8-47b5-ac3b-f2756883be27 req-e35c83b7-019c-4fd4-928b-589758a0a3ba service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] No waiting events found dispatching network-vif-plugged-1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:09 user nova-compute[70914]: WARNING nova.compute.manager [req-5f01df87-73c8-47b5-ac3b-f2756883be27 req-e35c83b7-019c-4fd4-928b-589758a0a3ba service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Received unexpected event network-vif-plugged-1d5a6186-4f09-4030-b47f-d13117b7310a for instance with vm_state building and task_state spawning.
Jul 27 13:43:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465391.2388258, 617c1690-feaf-4158-be9c-bb53cb74d31f => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:43:11 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] VM Resumed (Lifecycle Event)
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:43:11 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Instance spawned successfully.
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-e79c4e98-d83d-4534-ba3b-e4d11d1c79bb req-d730df6c-b3d1-4790-b654-6621c8e349e9 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Received event network-vif-plugged-1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e79c4e98-d83d-4534-ba3b-e4d11d1c79bb req-d730df6c-b3d1-4790-b654-6621c8e349e9 service nova] Acquiring lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e79c4e98-d83d-4534-ba3b-e4d11d1c79bb req-d730df6c-b3d1-4790-b654-6621c8e349e9 service nova] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e79c4e98-d83d-4534-ba3b-e4d11d1c79bb req-d730df6c-b3d1-4790-b654-6621c8e349e9 service nova] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-e79c4e98-d83d-4534-ba3b-e4d11d1c79bb req-d730df6c-b3d1-4790-b654-6621c8e349e9 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] No waiting events found dispatching network-vif-plugged-1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:11 user nova-compute[70914]: WARNING nova.compute.manager [req-e79c4e98-d83d-4534-ba3b-e4d11d1c79bb req-d730df6c-b3d1-4790-b654-6621c8e349e9 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Received unexpected event network-vif-plugged-1d5a6186-4f09-4030-b47f-d13117b7310a for instance with vm_state building and task_state spawning.
Jul 27 13:43:11 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465391.23899, 617c1690-feaf-4158-be9c-bb53cb74d31f => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:43:11 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] VM Started (Lifecycle Event)
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:43:11 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:43:11 user nova-compute[70914]: INFO nova.compute.manager [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Took 6.08 seconds to spawn the instance on the hypervisor.
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:43:11 user nova-compute[70914]: INFO nova.compute.manager [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Took 7.09 seconds to build instance.
Jul 27 13:43:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49f234d0-732e-4ece-a909-21a117f1f096 tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.232s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:43:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:12 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:43:12 user nova-compute[70914]: INFO nova.compute.claims [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Claim successful on node user
Jul 27 13:43:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:12 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:43:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:43:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:43:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:43:12 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:43:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:43:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:43:13 user nova-compute[70914]: INFO nova.virt.block_device [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Booting with blank volume at /dev/vda
Jul 27 13:43:13 user nova-compute[70914]: DEBUG nova.policy [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89bc44e787074838ba46afd3f81262f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9647080d1194d60aeb390b127895474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:43:13 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465378.695259, 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:43:13 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] VM Stopped (Lifecycle Event)
Jul 27 13:43:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-35d65577-3ca0-4264-8f52-b7b0bb1e89bd None None] [instance: 4fd926d9-5cc3-4e14-83cc-f19ab8b84c31] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:43:13 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Successfully created port: 0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:43:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Successfully updated port: 0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:43:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:43:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquired lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:43:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:43:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-1f391a20-5b19-4e74-86be-11fdda4e2972 req-43c69b89-ca8b-46ef-ac83-e6f25b3a1375 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-changed-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-1f391a20-5b19-4e74-86be-11fdda4e2972 req-43c69b89-ca8b-46ef-ac83-e6f25b3a1375 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Refreshing instance network info cache due to event network-changed-0976e6f9-568a-42b8-8b0e-b135d2203749. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:43:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f391a20-5b19-4e74-86be-11fdda4e2972 req-43c69b89-ca8b-46ef-ac83-e6f25b3a1375 service nova] Acquiring lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:43:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:43:15 user nova-compute[70914]: DEBUG nova.network.neutron [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updating instance_info_cache with network_info: [{"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Releasing lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:43:15 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Instance network_info: |[{"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:43:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f391a20-5b19-4e74-86be-11fdda4e2972 req-43c69b89-ca8b-46ef-ac83-e6f25b3a1375 service nova] Acquired lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:43:15 user nova-compute[70914]: DEBUG nova.network.neutron [req-1f391a20-5b19-4e74-86be-11fdda4e2972 req-43c69b89-ca8b-46ef-ac83-e6f25b3a1375 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Refreshing network info cache for port 0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:43:15 user nova-compute[70914]: DEBUG nova.network.neutron [req-1f391a20-5b19-4e74-86be-11fdda4e2972 req-43c69b89-ca8b-46ef-ac83-e6f25b3a1375 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updated VIF entry in instance network info cache for port 0976e6f9-568a-42b8-8b0e-b135d2203749. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:43:15 user nova-compute[70914]: DEBUG nova.network.neutron [req-1f391a20-5b19-4e74-86be-11fdda4e2972 req-43c69b89-ca8b-46ef-ac83-e6f25b3a1375 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updating instance_info_cache with network_info: [{"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f391a20-5b19-4e74-86be-11fdda4e2972 req-43c69b89-ca8b-46ef-ac83-e6f25b3a1375 service nova] Releasing lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:43:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG os_brick.utils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b40e337-51ff-4880-94e3-476d4d1de444]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a5a742-10dd-426a-9405-2852b642a61b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[527adf35-ef8d-4036-9836-17d9f3a03608]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[025fac1f-10ac-4521-8997-bda056145603]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:43:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:43:19 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:43:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ee6b6-008c-4f81-b59f-927681b2eeb3]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:43:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:43:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:43:19 user nova-compute[70914]: DEBUG os_brick.utils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:43:19 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updating existing volume attachment record: f6e2061d-45ff-4c5c-a042-799b1fb2bf13 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:43:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:43:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Creating image(s)
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Ensure instance console log exists: /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Start _get_guest_xml network_info=[{"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'f6e2061d-45ff-4c5c-a042-799b1fb2bf13', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAqoEYwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45a01fa6-81c7-4f78-83a8-83fb11cdb1cc', 'attached_at': '', 'detached_at': '', 'volume_id': '1450a005-ef4f-4fc8-a2a2-6920e8f921bc', 'serial': '1450a005-ef4f-4fc8-a2a2-6920e8f921bc'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:43:26 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:43:26 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAqoEYwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:43:26 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:43:26 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:43:26 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4d5660-990f-4daf-a4ee-0f1beb4a417e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:43:26 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f7b18d-0283-4d1a-81d5-092bce9f9732]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc] added
Jul 27 13:43:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a36028e-2b46-492b-b3c9-f3964b8ecc1d]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5695f111-ae84-43bf-9d78-8d82ed7258cf]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAqoEYwN {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAqoEYwN" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58cf1e0-e461-4b88-94ee-995b28d21510]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAqoEYwN'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c6e10d-5bb1-4b35-9463-373e18f6da30]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1ba49a-0abc-452b-809d-832ba80849c5]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:43:26 user nova-compute[70914]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:43:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:43:26 user nova-compute[70914]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:43:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa92da-2a03-46b4-a08a-2398e5b83dce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc, portal: 172.16.0.220,3260]
Jul 27 13:43:26 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc, portal: 172.16.0.220,3260] successful.
Jul 27 13:43:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0179158a-197e-40ea-a6d6-efe865084f88]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[422bb056-0b24-4257-90d9-16239580a895]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:43:26 user nova-compute[70914]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:43:26 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:43:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:43:26 user nova-compute[70914]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:43:26 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:43:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad84602-4780-4faf-b62a-1ef16a16f64b]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:43:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAqoEYwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23839313632316434', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839313632316434', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-31353135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-31353135',id=27,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-bbhk20d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:43:13Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=45a01fa6-81c7-4f78-83a8-83fb11cdb1cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:cb:32,bridge_name='br-int',has_traffic_filtering=True,id=0976e6f9-568a-42b8-8b0e-b135d2203749,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976e6f9-56') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.objects.instance [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'pci_devices' on Instance uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:43:27 user nova-compute[70914]:   <uuid>45a01fa6-81c7-4f78-83a8-83fb11cdb1cc</uuid>
Jul 27 13:43:27 user nova-compute[70914]:   <name>instance-0000001b</name>
Jul 27 13:43:27 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:43:27 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:43:27 user nova-compute[70914]:   <metadata>
Jul 27 13:43:27 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:43:27 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:43:27 user nova-compute[70914]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-31353135</nova:name>
Jul 27 13:43:27 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:43:26</nova:creationTime>
Jul 27 13:43:27 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:43:27 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:43:27 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:43:27 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:43:27 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:43:27 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:43:27 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:43:27 user nova-compute[70914]:       <nova:owner>
Jul 27 13:43:27 user nova-compute[70914]:         <nova:user uuid="89bc44e787074838ba46afd3f81262f0">tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member</nova:user>
Jul 27 13:43:27 user nova-compute[70914]:         <nova:project uuid="e9647080d1194d60aeb390b127895474">tempest-ServerBootFromVolumeStableRescueTest-853279030</nova:project>
Jul 27 13:43:27 user nova-compute[70914]:       </nova:owner>
Jul 27 13:43:27 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:43:27 user nova-compute[70914]:       <nova:ports>
Jul 27 13:43:27 user nova-compute[70914]:         <nova:port uuid="0976e6f9-568a-42b8-8b0e-b135d2203749">
Jul 27 13:43:27 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 13:43:27 user nova-compute[70914]:         </nova:port>
Jul 27 13:43:27 user nova-compute[70914]:       </nova:ports>
Jul 27 13:43:27 user nova-compute[70914]:     </nova:instance>
Jul 27 13:43:27 user nova-compute[70914]:   </metadata>
Jul 27 13:43:27 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:43:27 user nova-compute[70914]:     <system>
Jul 27 13:43:27 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:43:27 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:43:27 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:43:27 user nova-compute[70914]:       <entry name="serial">45a01fa6-81c7-4f78-83a8-83fb11cdb1cc</entry>
Jul 27 13:43:27 user nova-compute[70914]:       <entry name="uuid">45a01fa6-81c7-4f78-83a8-83fb11cdb1cc</entry>
Jul 27 13:43:27 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:43:27 user nova-compute[70914]:     </system>
Jul 27 13:43:27 user nova-compute[70914]:   </sysinfo>
Jul 27 13:43:27 user nova-compute[70914]:   <os>
Jul 27 13:43:27 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:43:27 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:43:27 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:43:27 user nova-compute[70914]:   </os>
Jul 27 13:43:27 user nova-compute[70914]:   <features>
Jul 27 13:43:27 user nova-compute[70914]:     <acpi/>
Jul 27 13:43:27 user nova-compute[70914]:     <apic/>
Jul 27 13:43:27 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:43:27 user nova-compute[70914]:   </features>
Jul 27 13:43:27 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:43:27 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:43:27 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:43:27 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:43:27 user nova-compute[70914]:   </clock>
Jul 27 13:43:27 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:43:27 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:43:27 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:43:27 user nova-compute[70914]:   </cpu>
Jul 27 13:43:27 user nova-compute[70914]:   <devices>
Jul 27 13:43:27 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:43:27 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:43:27 user nova-compute[70914]:       <source dev="/dev/sdc"/>
Jul 27 13:43:27 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:43:27 user nova-compute[70914]:       <serial>1450a005-ef4f-4fc8-a2a2-6920e8f921bc</serial>
Jul 27 13:43:27 user nova-compute[70914]:     </disk>
Jul 27 13:43:27 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:43:27 user nova-compute[70914]:       <mac address="fa:16:3e:9a:cb:32"/>
Jul 27 13:43:27 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:43:27 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:43:27 user nova-compute[70914]:       <target dev="tap0976e6f9-56"/>
Jul 27 13:43:27 user nova-compute[70914]:     </interface>
Jul 27 13:43:27 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:43:27 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/console.log" append="off"/>
Jul 27 13:43:27 user nova-compute[70914]:     </serial>
Jul 27 13:43:27 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:43:27 user nova-compute[70914]:     <video>
Jul 27 13:43:27 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:43:27 user nova-compute[70914]:     </video>
Jul 27 13:43:27 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:43:27 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:43:27 user nova-compute[70914]:     </rng>
Jul 27 13:43:27 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:43:27 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:43:27 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:43:27 user nova-compute[70914]:     </memballoon>
Jul 27 13:43:27 user nova-compute[70914]:   </devices>
Jul 27 13:43:27 user nova-compute[70914]: </domain>
Jul 27 13:43:27 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-31353135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-31353135',id=27,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-bbhk20d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:43:13Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=45a01fa6-81c7-4f78-83a8-83fb11cdb1cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:cb:32,bridge_name='br-int',has_traffic_filtering=True,id=0976e6f9-568a-42b8-8b0e-b135d2203749,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976e6f9-56') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG os_vif [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:cb:32,bridge_name='br-int',has_traffic_filtering=True,id=0976e6f9-568a-42b8-8b0e-b135d2203749,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976e6f9-56') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0976e6f9-56, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0976e6f9-56, col_values=(('external_ids', {'iface-id': '0976e6f9-568a-42b8-8b0e-b135d2203749', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:cb:32', 'vm-uuid': '45a01fa6-81c7-4f78-83a8-83fb11cdb1cc'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:27 user nova-compute[70914]: INFO os_vif [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:cb:32,bridge_name='br-int',has_traffic_filtering=True,id=0976e6f9-568a-42b8-8b0e-b135d2203749,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976e6f9-56')
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:43:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No VIF found with MAC fa:16:3e:9a:cb:32, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:43:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-ce786127-db9a-4c0e-a840-c1b27f8cdd9f req-7a1c1a55-8915-494e-ad9a-32c1bf7df4e2 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ce786127-db9a-4c0e-a840-c1b27f8cdd9f req-7a1c1a55-8915-494e-ad9a-32c1bf7df4e2 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ce786127-db9a-4c0e-a840-c1b27f8cdd9f req-7a1c1a55-8915-494e-ad9a-32c1bf7df4e2 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ce786127-db9a-4c0e-a840-c1b27f8cdd9f req-7a1c1a55-8915-494e-ad9a-32c1bf7df4e2 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-ce786127-db9a-4c0e-a840-c1b27f8cdd9f req-7a1c1a55-8915-494e-ad9a-32c1bf7df4e2 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:29 user nova-compute[70914]: WARNING nova.compute.manager [req-ce786127-db9a-4c0e-a840-c1b27f8cdd9f req-7a1c1a55-8915-494e-ad9a-32c1bf7df4e2 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state building and task_state spawning.
Jul 27 13:43:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465411.2931008, 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:43:31 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] VM Resumed (Lifecycle Event)
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:43:31 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Instance spawned successfully.
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:43:31 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465411.2962785, 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:43:31 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] VM Started (Lifecycle Event)
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-b825ca48-a0fa-44ac-9d04-715e76a54ba4 req-ee4b10f4-0cf6-403f-b4d6-755e5b4cfcf0 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b825ca48-a0fa-44ac-9d04-715e76a54ba4 req-ee4b10f4-0cf6-403f-b4d6-755e5b4cfcf0 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b825ca48-a0fa-44ac-9d04-715e76a54ba4 req-ee4b10f4-0cf6-403f-b4d6-755e5b4cfcf0 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b825ca48-a0fa-44ac-9d04-715e76a54ba4 req-ee4b10f4-0cf6-403f-b4d6-755e5b4cfcf0 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-b825ca48-a0fa-44ac-9d04-715e76a54ba4 req-ee4b10f4-0cf6-403f-b4d6-755e5b4cfcf0 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:31 user nova-compute[70914]: WARNING nova.compute.manager [req-b825ca48-a0fa-44ac-9d04-715e76a54ba4 req-ee4b10f4-0cf6-403f-b4d6-755e5b4cfcf0 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state building and task_state spawning.
Jul 27 13:43:31 user nova-compute[70914]: INFO nova.compute.manager [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Took 5.07 seconds to spawn the instance on the hypervisor.
Jul 27 13:43:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:43:31 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:43:31 user nova-compute[70914]: INFO nova.compute.manager [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Took 19.49 seconds to build instance.
Jul 27 13:43:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf2446d5-ff60-40f5-ac3a-89f551115b6b tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.634s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:39 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:43:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:43:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:43:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:43:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:43:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:43:45 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:43:45 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=6918MB free_disk=25.264842987060547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 509e7547-8472-4954-8fc6-a152e9667437 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 10fa8c48-a95a-411f-9de0-aabf19455f57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 30050776-6e41-487a-9ad2-342b18a7b72f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0371b280-fc39-4cbd-b496-ba78fea4e856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8897428a-7e38-49ed-9013-df0d2160196e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 617c1690-feaf-4158-be9c-bb53cb74d31f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:43:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:43:46 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:43:46 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:43:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:43:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:48 user nova-compute[70914]: INFO nova.compute.manager [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Terminating instance
Jul 27 13:43:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-6c6f1413-13db-41a0-a350-7a29fc310816 req-45a036bc-114c-4ba3-a9ba-643da68cb876 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-unplugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6c6f1413-13db-41a0-a350-7a29fc310816 req-45a036bc-114c-4ba3-a9ba-643da68cb876 service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6c6f1413-13db-41a0-a350-7a29fc310816 req-45a036bc-114c-4ba3-a9ba-643da68cb876 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6c6f1413-13db-41a0-a350-7a29fc310816 req-45a036bc-114c-4ba3-a9ba-643da68cb876 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-6c6f1413-13db-41a0-a350-7a29fc310816 req-45a036bc-114c-4ba3-a9ba-643da68cb876 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-unplugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-6c6f1413-13db-41a0-a350-7a29fc310816 req-45a036bc-114c-4ba3-a9ba-643da68cb876 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-unplugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:43:48 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Instance destroyed successfully.
Jul 27 13:43:48 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lazy-loading 'resources' on Instance uuid 509e7547-8472-4954-8fc6-a152e9667437 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1913153645',display_name='tempest-ServerStableDeviceRescueTest-server-1913153645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1913153645',id=16,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZtuqdDZDWOo97xKSb50o/8caWeMVr1tpEgfVE3erZUrnk/Hj4h9xffFcTwfYQRu4cXbjx+cdPga1/B+bf3ZwFDBubo5FIMGXYw908pwMqhui2gKJnbtIQfYUegpcdxfw==',key_name='tempest-keypair-1364291766',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:40:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03eaeefb7bc34913b18c81eb68c2e053',ramdisk_id='',reservation_id='r-z8urou9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-11916342',owner_user_name='tempest-ServerStableDeviceRescueTest-11916342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='461c5809f98c42daa7520c1bd0477ffd',uuid=509e7547-8472-4954-8fc6-a152e9667437,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Converting VIF {"id": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "address": "fa:16:3e:8b:f4:cc", "network": {"id": "ca534528-e241-4a4c-9ee7-30b7a67170e4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-869105304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03eaeefb7bc34913b18c81eb68c2e053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c115254-d0", "ovs_interfaceid": "7c115254-d063-49fe-b94c-e7a22b8ccb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f4:cc,bridge_name='br-int',has_traffic_filtering=True,id=7c115254-d063-49fe-b94c-e7a22b8ccb31,network=Network(ca534528-e241-4a4c-9ee7-30b7a67170e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c115254-d0') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG os_vif [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f4:cc,bridge_name='br-int',has_traffic_filtering=True,id=7c115254-d063-49fe-b94c-e7a22b8ccb31,network=Network(ca534528-e241-4a4c-9ee7-30b7a67170e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c115254-d0') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c115254-d0, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:43:48 user nova-compute[70914]: INFO os_vif [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f4:cc,bridge_name='br-int',has_traffic_filtering=True,id=7c115254-d063-49fe-b94c-e7a22b8ccb31,network=Network(ca534528-e241-4a4c-9ee7-30b7a67170e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c115254-d0')
Jul 27 13:43:48 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Deleting instance files /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437_del
Jul 27 13:43:48 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Deletion of /opt/stack/data/nova/instances/509e7547-8472-4954-8fc6-a152e9667437_del complete
Jul 27 13:43:49 user nova-compute[70914]: INFO nova.compute.manager [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 27 13:43:49 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 509e7547-8472-4954-8fc6-a152e9667437] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updating instance_info_cache with network_info: [{"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-ce13163a-b88b-4831-a934-83d28585d510 req-6ee566da-e44f-4ab1-94a9-e56f5474f202 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-deleted-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:49 user nova-compute[70914]: INFO nova.compute.manager [req-ce13163a-b88b-4831-a934-83d28585d510 req-6ee566da-e44f-4ab1-94a9-e56f5474f202 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Neutron deleted interface 7c115254-d063-49fe-b94c-e7a22b8ccb31; detaching it from the instance and deleting it from the info cache
Jul 27 13:43:49 user nova-compute[70914]: DEBUG nova.network.neutron [req-ce13163a-b88b-4831-a934-83d28585d510 req-6ee566da-e44f-4ab1-94a9-e56f5474f202 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:49 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Took 0.83 seconds to deallocate network for instance.
Jul 27 13:43:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-ce13163a-b88b-4831-a934-83d28585d510 req-6ee566da-e44f-4ab1-94a9-e56f5474f202 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Detach interface failed, port_id=7c115254-d063-49fe-b94c-e7a22b8ccb31, reason: Instance 509e7547-8472-4954-8fc6-a152e9667437 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:50 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:43:50 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:43:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:50 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Deleted allocations for instance 509e7547-8472-4954-8fc6-a152e9667437
Jul 27 13:43:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c25f1100-bee0-48c3-832e-0914b0eb2a54 tempest-ServerStableDeviceRescueTest-11916342 tempest-ServerStableDeviceRescueTest-11916342-project-member] Lock "509e7547-8472-4954-8fc6-a152e9667437" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.401s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-638c5571-6da8-4b11-b5da-06f19754454e req-9ea2392f-fd60-4efc-ba86-870d14a76d45 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-638c5571-6da8-4b11-b5da-06f19754454e req-9ea2392f-fd60-4efc-ba86-870d14a76d45 service nova] Acquiring lock "509e7547-8472-4954-8fc6-a152e9667437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-638c5571-6da8-4b11-b5da-06f19754454e req-9ea2392f-fd60-4efc-ba86-870d14a76d45 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-638c5571-6da8-4b11-b5da-06f19754454e req-9ea2392f-fd60-4efc-ba86-870d14a76d45 service nova] Lock "509e7547-8472-4954-8fc6-a152e9667437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-638c5571-6da8-4b11-b5da-06f19754454e req-9ea2392f-fd60-4efc-ba86-870d14a76d45 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] No waiting events found dispatching network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:50 user nova-compute[70914]: WARNING nova.compute.manager [req-638c5571-6da8-4b11-b5da-06f19754454e req-9ea2392f-fd60-4efc-ba86-870d14a76d45 service nova] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Received unexpected event network-vif-plugged-7c115254-d063-49fe-b94c-e7a22b8ccb31 for instance with vm_state deleted and task_state None.
Jul 27 13:43:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:54 user nova-compute[70914]: INFO nova.compute.manager [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Terminating instance
Jul 27 13:43:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-ff86aa27-05ea-40eb-ac70-e14d4e08c4c2 req-0c8406f4-4529-4737-8da7-fce93bfb5dd1 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received event network-vif-unplugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ff86aa27-05ea-40eb-ac70-e14d4e08c4c2 req-0c8406f4-4529-4737-8da7-fce93bfb5dd1 service nova] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ff86aa27-05ea-40eb-ac70-e14d4e08c4c2 req-0c8406f4-4529-4737-8da7-fce93bfb5dd1 service nova] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ff86aa27-05ea-40eb-ac70-e14d4e08c4c2 req-0c8406f4-4529-4737-8da7-fce93bfb5dd1 service nova] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-ff86aa27-05ea-40eb-ac70-e14d4e08c4c2 req-0c8406f4-4529-4737-8da7-fce93bfb5dd1 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] No waiting events found dispatching network-vif-unplugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-ff86aa27-05ea-40eb-ac70-e14d4e08c4c2 req-0c8406f4-4529-4737-8da7-fce93bfb5dd1 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received event network-vif-unplugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:43:55 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Instance destroyed successfully.
Jul 27 13:43:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lazy-loading 'resources' on Instance uuid 10fa8c48-a95a-411f-9de0-aabf19455f57 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:43:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1055498625',display_name='tempest-VolumesAdminNegativeTest-server-1055498625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1055498625',id=19,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9qiIdtEZBGn/VUXpZBhN6UDEO+Lo6dkWHTHqunhBQWTKSvweq1YMLNjZ02iz3PIK2eVM1q8vqTxGY3tN1jB8qWu7QZvhdu96H92E9vhq/5wpOyQK12kqKcJMW1LkSIzg==',key_name='tempest-keypair-1745123018',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61774ce82df2478186c9bbed654b8c4d',ramdisk_id='',reservation_id='r-qi91vbbq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1597280425',owner_user_name='tempest-VolumesAdminNegativeTest-1597280425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a3be9b082b4facadeff78db34d2519',uuid=10fa8c48-a95a-411f-9de0-aabf19455f57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:43:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converting VIF {"id": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "address": "fa:16:3e:76:1d:3b", "network": {"id": "213f6f58-032a-4f5d-9788-94953686ff21", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1461418203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61774ce82df2478186c9bbed654b8c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57228a08-7e", "ovs_interfaceid": "57228a08-7e4c-4c7b-bbcd-ada78b6ec66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:43:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:1d:3b,bridge_name='br-int',has_traffic_filtering=True,id=57228a08-7e4c-4c7b-bbcd-ada78b6ec66e,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57228a08-7e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:43:55 user nova-compute[70914]: DEBUG os_vif [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:1d:3b,bridge_name='br-int',has_traffic_filtering=True,id=57228a08-7e4c-4c7b-bbcd-ada78b6ec66e,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57228a08-7e') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:43:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57228a08-7e, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:43:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:43:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:43:55 user nova-compute[70914]: INFO os_vif [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:1d:3b,bridge_name='br-int',has_traffic_filtering=True,id=57228a08-7e4c-4c7b-bbcd-ada78b6ec66e,network=Network(213f6f58-032a-4f5d-9788-94953686ff21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57228a08-7e')
Jul 27 13:43:55 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Deleting instance files /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57_del
Jul 27 13:43:55 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Deletion of /opt/stack/data/nova/instances/10fa8c48-a95a-411f-9de0-aabf19455f57_del complete
Jul 27 13:43:55 user nova-compute[70914]: INFO nova.compute.manager [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 27 13:43:55 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:43:55 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:43:55 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:56 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Took 0.97 seconds to deallocate network for instance.
Jul 27 13:43:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-9ca36e6f-1a4f-4db8-8b94-6708adef880d req-9ee64a23-9871-4b69-a531-9d2347b06c27 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received event network-vif-deleted-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:56 user nova-compute[70914]: INFO nova.compute.manager [req-9ca36e6f-1a4f-4db8-8b94-6708adef880d req-9ee64a23-9871-4b69-a531-9d2347b06c27 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Neutron deleted interface 57228a08-7e4c-4c7b-bbcd-ada78b6ec66e; detaching it from the instance and deleting it from the info cache
Jul 27 13:43:56 user nova-compute[70914]: DEBUG nova.network.neutron [req-9ca36e6f-1a4f-4db8-8b94-6708adef880d req-9ee64a23-9871-4b69-a531-9d2347b06c27 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-9ca36e6f-1a4f-4db8-8b94-6708adef880d req-9ee64a23-9871-4b69-a531-9d2347b06c27 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Detach interface failed, port_id=57228a08-7e4c-4c7b-bbcd-ada78b6ec66e, reason: Instance 10fa8c48-a95a-411f-9de0-aabf19455f57 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:56 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Deleted allocations for instance 10fa8c48-a95a-411f-9de0-aabf19455f57
Jul 27 13:43:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8719cb60-93aa-470d-9291-980d6d81b9c7 tempest-VolumesAdminNegativeTest-1597280425 tempest-VolumesAdminNegativeTest-1597280425-project-member] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.372s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-6a9d9c23-f558-4b75-beb7-2a93bf31aea4 req-77069915-0539-4a5a-b4ae-d63ecfcdeee0 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received event network-vif-plugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6a9d9c23-f558-4b75-beb7-2a93bf31aea4 req-77069915-0539-4a5a-b4ae-d63ecfcdeee0 service nova] Acquiring lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6a9d9c23-f558-4b75-beb7-2a93bf31aea4 req-77069915-0539-4a5a-b4ae-d63ecfcdeee0 service nova] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6a9d9c23-f558-4b75-beb7-2a93bf31aea4 req-77069915-0539-4a5a-b4ae-d63ecfcdeee0 service nova] Lock "10fa8c48-a95a-411f-9de0-aabf19455f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:43:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-6a9d9c23-f558-4b75-beb7-2a93bf31aea4 req-77069915-0539-4a5a-b4ae-d63ecfcdeee0 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] No waiting events found dispatching network-vif-plugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:43:56 user nova-compute[70914]: WARNING nova.compute.manager [req-6a9d9c23-f558-4b75-beb7-2a93bf31aea4 req-77069915-0539-4a5a-b4ae-d63ecfcdeee0 service nova] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Received unexpected event network-vif-plugged-57228a08-7e4c-4c7b-bbcd-ada78b6ec66e for instance with vm_state deleted and task_state None.
Jul 27 13:44:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:02 user nova-compute[70914]: INFO nova.compute.manager [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Detaching volume 26050a23-0784-4dcc-acaa-3aa249154c33
Jul 27 13:44:03 user nova-compute[70914]: INFO nova.virt.block_device [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Attempting to driver detach volume 26050a23-0784-4dcc-acaa-3aa249154c33 from mountpoint /dev/vdb
Jul 27 13:44:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Attempting to detach device vdb from instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:44:03 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:44:03 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:44:03 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:44:03 user nova-compute[70914]:   <serial>26050a23-0784-4dcc-acaa-3aa249154c33</serial>
Jul 27 13:44:03 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 13:44:03 user nova-compute[70914]: </disk>
Jul 27 13:44:03 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:44:03 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully detached device vdb from instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 from the persistent domain config.
Jul 27 13:44:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:44:03 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:44:03 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:44:03 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:44:03 user nova-compute[70914]:   <serial>26050a23-0784-4dcc-acaa-3aa249154c33</serial>
Jul 27 13:44:03 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 13:44:03 user nova-compute[70914]: </disk>
Jul 27 13:44:03 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465443.5059323, 814e062c-85d1-486b-8c7e-9198fbfc5f63 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:44:03 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully detached device vdb from instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 from the live domain config.
Jul 27 13:44:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdPUNMWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:44:03 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a1464c-7c1e-420e-aa01-1de6a0a24c57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:44:03 user nova-compute[70914]: No targets found.
Jul 27 13:44:03 user nova-compute[70914]: iSNS:
Jul 27 13:44:03 user nova-compute[70914]: No targets found.
Jul 27 13:44:03 user nova-compute[70914]: STATIC:
Jul 27 13:44:03 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174
Jul 27 13:44:03 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:44:03 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:44:03 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:44:03 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:44:03 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:44:03 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33
Jul 27 13:44:03 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:44:03 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:44:03 user nova-compute[70914]: FIRMWARE:
Jul 27 13:44:03 user nova-compute[70914]: No targets found.
Jul 27 13:44:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:44:03 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:44:03 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[390bb2ce-cadb-491d-a103-62c3c689dcb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[88793f39-f093-4009-b0db-f7225e786a4e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:44:03 user nova-compute[70914]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:03 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 (non-flash)
Jul 27 13:44:03 user nova-compute[70914]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:03 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c1855a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fb16e5-aa9c-4d2a-ac69-2847c8d0084d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ffffd1-b7bc-4b7c-9123-ba9d0fc05878]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbf6cc9-8857-48d4-a967-599552dc40cb]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[540c3752-cdf0-4977-bdc6-7c6a7a7da972]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d8f2ff-d471-4771-98d1-f54021cc0a7b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf99cd6-1b0e-419a-8224-aaaf1db7e593]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260]
Jul 27 13:44:03 user nova-compute[70914]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33, portal: 172.16.0.220,3260] successful.
Jul 27 13:44:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26050a23-0784-4dcc-acaa-3aa249154c33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1efd5a-e99a-4029-b134-e009f1bbd3d1]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== disconnect_volume: return (300ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:44:03 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465428.9032812, 509e7547-8472-4954-8fc6-a152e9667437 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:44:03 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 509e7547-8472-4954-8fc6-a152e9667437] VM Stopped (Lifecycle Event)
Jul 27 13:44:03 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d72fa3f6-df51-4ceb-8f10-4195c9219e37 None None] [instance: 509e7547-8472-4954-8fc6-a152e9667437] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:04 user nova-compute[70914]: DEBUG nova.objects.instance [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'flavor' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-57024c33-e0f1-404d-84c7-1effaab26131 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.635s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:10 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465435.0127723, 10fa8c48-a95a-411f-9de0-aabf19455f57 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:44:10 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] VM Stopped (Lifecycle Event)
Jul 27 13:44:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3ffcf0be-ff84-4b4a-8683-cb2440ba5666 None None] [instance: 10fa8c48-a95a-411f-9de0-aabf19455f57] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:44:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:44:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:44:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:44:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'flavor' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:19 user nova-compute[70914]: INFO nova.compute.manager [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Attaching volume 92a085ff-339a-4b95-a1fb-6ac855b1a188 to /dev/vdb
Jul 27 13:44:19 user nova-compute[70914]: DEBUG os_brick.utils [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c7d84-11ac-4e4a-bb53-f0ecb9edc20c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd212b3-de10-4329-b71c-8b59bc0ff97b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7c9b5d-55f7-4a8d-a077-38eab63776b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2536fedf-4729-42e6-89ab-c759285486b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:44:19 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:44:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deea541-f4e4-4c51-998b-3feec6a63f54]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG os_brick.utils [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:44:19 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updating existing volume attachment record: 3e547cc7-6f7e-42d5-a5dd-04e4fc5f5fbb {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:44:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a96c5fd-a5ff-45bd-b695-6ced8dc00220 req-f5e4c893-efa1-4ddf-97b4-fd9d00c189d2 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-changed-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a96c5fd-a5ff-45bd-b695-6ced8dc00220 req-f5e4c893-efa1-4ddf-97b4-fd9d00c189d2 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Refreshing instance network info cache due to event network-changed-ef1f245c-0a46-4cd8-8851-c93741559d97. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:44:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a96c5fd-a5ff-45bd-b695-6ced8dc00220 req-f5e4c893-efa1-4ddf-97b4-fd9d00c189d2 service nova] Acquiring lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:44:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a96c5fd-a5ff-45bd-b695-6ced8dc00220 req-f5e4c893-efa1-4ddf-97b4-fd9d00c189d2 service nova] Acquired lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:44:22 user nova-compute[70914]: DEBUG nova.network.neutron [req-2a96c5fd-a5ff-45bd-b695-6ced8dc00220 req-f5e4c893-efa1-4ddf-97b4-fd9d00c189d2 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Refreshing network info cache for port ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:44:22 user nova-compute[70914]: DEBUG nova.network.neutron [req-2a96c5fd-a5ff-45bd-b695-6ced8dc00220 req-f5e4c893-efa1-4ddf-97b4-fd9d00c189d2 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updated VIF entry in instance network info cache for port ef1f245c-0a46-4cd8-8851-c93741559d97. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:44:22 user nova-compute[70914]: DEBUG nova.network.neutron [req-2a96c5fd-a5ff-45bd-b695-6ced8dc00220 req-f5e4c893-efa1-4ddf-97b4-fd9d00c189d2 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updating instance_info_cache with network_info: [{"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:44:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a96c5fd-a5ff-45bd-b695-6ced8dc00220 req-f5e4c893-efa1-4ddf-97b4-fd9d00c189d2 service nova] Releasing lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:44:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:26 user nova-compute[70914]: INFO nova.compute.manager [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Shelving
Jul 27 13:44:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZsyQJeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:44:26 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:44:26 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:44:26 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746b614-51b8-4da8-9e00-d4bb9f7d4734]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:44:26 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e7bb53-44cc-45d9-af04-ad6b2611eb2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188] added
Jul 27 13:44:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-c7a5c86d-79b1-4d04-9d7b-183a1dc764cc req-8f79e742-11d8-4d45-a458-d0ba3bb72749 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-vif-unplugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c7a5c86d-79b1-4d04-9d7b-183a1dc764cc req-8f79e742-11d8-4d45-a458-d0ba3bb72749 service nova] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c7a5c86d-79b1-4d04-9d7b-183a1dc764cc req-8f79e742-11d8-4d45-a458-d0ba3bb72749 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c7a5c86d-79b1-4d04-9d7b-183a1dc764cc req-8f79e742-11d8-4d45-a458-d0ba3bb72749 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-c7a5c86d-79b1-4d04-9d7b-183a1dc764cc req-8f79e742-11d8-4d45-a458-d0ba3bb72749 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] No waiting events found dispatching network-vif-unplugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:26 user nova-compute[70914]: WARNING nova.compute.manager [req-c7a5c86d-79b1-4d04-9d7b-183a1dc764cc req-8f79e742-11d8-4d45-a458-d0ba3bb72749 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received unexpected event network-vif-unplugged-ef1f245c-0a46-4cd8-8851-c93741559d97 for instance with vm_state active and task_state shelving.
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[161d8641-5d72-4085-99ae-c96bc7f04531]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f8e0e8-4121-493f-903d-85ee0ec82241]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZsyQJeH {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZsyQJeH" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[469b5a61-732c-4c49-b951-ca812764cc46]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZsyQJeH'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c506de-97fd-41e2-a515-dcbb84d9ce4a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f880786-6c60-4c5d-b923-ebbfb3db6590]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:26 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:26 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7233bec2-5782-4f67-960c-72508d174b44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260]
Jul 27 13:44:26 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260] successful.
Jul 27 13:44:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2804f2-66bd-4867-9111-6701c5a98df0]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[853c8335-00d1-4143-bb8e-c6d920b8fd1d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:26 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:26 user nova-compute[70914]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:44:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:26 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:26 user nova-compute[70914]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:44:26 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe2ebab-8fd4-4a0a-b38a-7c2605243d1f]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZsyQJeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:44:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Instance destroyed successfully.
Jul 27 13:44:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Beginning cold snapshot process
Jul 27 13:44:27 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:44:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk /opt/stack/data/nova/instances/snapshots/tmp6ega2je6/571264fbf3654264892767f72139af74 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk /opt/stack/data/nova/instances/snapshots/tmp6ega2je6/571264fbf3654264892767f72139af74" returned: 0 in 0.616s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Snapshot extracted, beginning image upload
Jul 27 13:44:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:44:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23437666334346337', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:44:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437666334346337', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:44:27 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'flavor' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:44:27 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:44:27 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:44:27 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:44:27 user nova-compute[70914]:   <serial>92a085ff-339a-4b95-a1fb-6ac855b1a188</serial>
Jul 27 13:44:27 user nova-compute[70914]: </disk>
Jul 27 13:44:27 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:44:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:44:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:44:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] No VIF found with MAC fa:16:3e:ff:b5:23, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:44:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c52f04fc-9687-45fe-9b35-a43f7e367872 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.107s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-eca8cc05-6904-447e-af33-7720a84d7935 req-135e81be-c65f-4f5d-b986-3368b8c81fa1 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-eca8cc05-6904-447e-af33-7720a84d7935 req-135e81be-c65f-4f5d-b986-3368b8c81fa1 service nova] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-eca8cc05-6904-447e-af33-7720a84d7935 req-135e81be-c65f-4f5d-b986-3368b8c81fa1 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-eca8cc05-6904-447e-af33-7720a84d7935 req-135e81be-c65f-4f5d-b986-3368b8c81fa1 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-eca8cc05-6904-447e-af33-7720a84d7935 req-135e81be-c65f-4f5d-b986-3368b8c81fa1 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] No waiting events found dispatching network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:28 user nova-compute[70914]: WARNING nova.compute.manager [req-eca8cc05-6904-447e-af33-7720a84d7935 req-135e81be-c65f-4f5d-b986-3368b8c81fa1 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received unexpected event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 for instance with vm_state active and task_state shelving_image_uploading.
Jul 27 13:44:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Snapshot image upload complete
Jul 27 13:44:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:30 user nova-compute[70914]: INFO nova.compute.manager [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Shelve offloading
Jul 27 13:44:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Instance destroyed successfully.
Jul 27 13:44:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:44:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquired lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:44:30 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:44:30 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updating instance_info_cache with network_info: [{"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:44:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Releasing lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:44:31 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Instance destroyed successfully.
Jul 27 13:44:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'resources' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1002806692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1002806692',id=24,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOp7kA5GsVKxK7vy6xGG3HUQDmGrBeuuo/lroY6vdSLHo0PMS4wZK7mlc0LUUIgDVuztVrn2KZy3eXeePOKG+URgPP4gtVe8S6ZdIaDay/2vu1i1r/qxxoyr11tBYjQurw==',key_name='tempest-keypair-1688577340',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:42:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-2uukqca4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member',shelved_at='2023-07-27T13:44:30.232019',shelved_host='user',shelved_image_id='191467a6-4de0-4308-a62e-cc5ed7bbd05e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=4e856bc3-ce45-4307-af2b-33c82ed1eccc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG os_vif [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef1f245c-0a, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-6f1cada5-137d-41ce-9d77-2f0f1de93713 req-f834352f-c77f-4988-8db0-6fad264ca2f8 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-changed-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-6f1cada5-137d-41ce-9d77-2f0f1de93713 req-f834352f-c77f-4988-8db0-6fad264ca2f8 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Refreshing instance network info cache due to event network-changed-ef1f245c-0a46-4cd8-8851-c93741559d97. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6f1cada5-137d-41ce-9d77-2f0f1de93713 req-f834352f-c77f-4988-8db0-6fad264ca2f8 service nova] Acquiring lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6f1cada5-137d-41ce-9d77-2f0f1de93713 req-f834352f-c77f-4988-8db0-6fad264ca2f8 service nova] Acquired lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG nova.network.neutron [req-6f1cada5-137d-41ce-9d77-2f0f1de93713 req-f834352f-c77f-4988-8db0-6fad264ca2f8 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Refreshing network info cache for port ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:44:31 user nova-compute[70914]: INFO os_vif [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a')
Jul 27 13:44:31 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Deleting instance files /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc_del
Jul 27 13:44:31 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Deletion of /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc_del complete
Jul 27 13:44:31 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Deleted allocations for instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc
Jul 27 13:44:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:32 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:44:32 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:44:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-6f1cada5-137d-41ce-9d77-2f0f1de93713 req-f834352f-c77f-4988-8db0-6fad264ca2f8 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updated VIF entry in instance network info cache for port ef1f245c-0a46-4cd8-8851-c93741559d97. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:44:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-6f1cada5-137d-41ce-9d77-2f0f1de93713 req-f834352f-c77f-4988-8db0-6fad264ca2f8 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updating instance_info_cache with network_info: [{"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapef1f245c-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:44:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6f1cada5-137d-41ce-9d77-2f0f1de93713 req-f834352f-c77f-4988-8db0-6fad264ca2f8 service nova] Releasing lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:44:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5aacedc2-4a5f-46d5-b7cc-157ed0c2b4e4 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.025s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-2dbfd210-1ce9-4b57-92e0-1b94acbb4b5e req-afba379c-1b52-4786-9003-1279b84910b5 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-changed-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-2dbfd210-1ce9-4b57-92e0-1b94acbb4b5e req-afba379c-1b52-4786-9003-1279b84910b5 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Refreshing instance network info cache due to event network-changed-4252cbc5-88bf-446c-abdb-46c174a0afa6. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:44:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2dbfd210-1ce9-4b57-92e0-1b94acbb4b5e req-afba379c-1b52-4786-9003-1279b84910b5 service nova] Acquiring lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:44:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2dbfd210-1ce9-4b57-92e0-1b94acbb4b5e req-afba379c-1b52-4786-9003-1279b84910b5 service nova] Acquired lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:44:36 user nova-compute[70914]: DEBUG nova.network.neutron [req-2dbfd210-1ce9-4b57-92e0-1b94acbb4b5e req-afba379c-1b52-4786-9003-1279b84910b5 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Refreshing network info cache for port 4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:44:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:37 user nova-compute[70914]: DEBUG nova.network.neutron [req-2dbfd210-1ce9-4b57-92e0-1b94acbb4b5e req-afba379c-1b52-4786-9003-1279b84910b5 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updated VIF entry in instance network info cache for port 4252cbc5-88bf-446c-abdb-46c174a0afa6. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:44:37 user nova-compute[70914]: DEBUG nova.network.neutron [req-2dbfd210-1ce9-4b57-92e0-1b94acbb4b5e req-afba379c-1b52-4786-9003-1279b84910b5 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updating instance_info_cache with network_info: [{"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:44:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2dbfd210-1ce9-4b57-92e0-1b94acbb4b5e req-afba379c-1b52-4786-9003-1279b84910b5 service nova] Releasing lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:44:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-1256b63c-a046-4610-8ab9-a3ec6707ac6e req-1293f598-502c-4340-bb91-dea7e5daa725 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-changed-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-1256b63c-a046-4610-8ab9-a3ec6707ac6e req-1293f598-502c-4340-bb91-dea7e5daa725 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Refreshing instance network info cache due to event network-changed-4252cbc5-88bf-446c-abdb-46c174a0afa6. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:44:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1256b63c-a046-4610-8ab9-a3ec6707ac6e req-1293f598-502c-4340-bb91-dea7e5daa725 service nova] Acquiring lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:44:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1256b63c-a046-4610-8ab9-a3ec6707ac6e req-1293f598-502c-4340-bb91-dea7e5daa725 service nova] Acquired lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:44:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-1256b63c-a046-4610-8ab9-a3ec6707ac6e req-1293f598-502c-4340-bb91-dea7e5daa725 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Refreshing network info cache for port 4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:44:40 user nova-compute[70914]: DEBUG nova.network.neutron [req-1256b63c-a046-4610-8ab9-a3ec6707ac6e req-1293f598-502c-4340-bb91-dea7e5daa725 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updated VIF entry in instance network info cache for port 4252cbc5-88bf-446c-abdb-46c174a0afa6. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:44:40 user nova-compute[70914]: DEBUG nova.network.neutron [req-1256b63c-a046-4610-8ab9-a3ec6707ac6e req-1293f598-502c-4340-bb91-dea7e5daa725 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updating instance_info_cache with network_info: [{"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:44:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1256b63c-a046-4610-8ab9-a3ec6707ac6e req-1293f598-502c-4340-bb91-dea7e5daa725 service nova] Releasing lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465466.870589, 4e856bc3-ce45-4307-af2b-33c82ed1eccc => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:44:41 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] VM Stopped (Lifecycle Event)
Jul 27 13:44:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-97871b6a-fd6e-42fe-9c7f-c6af7085438b None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:44:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:44 user nova-compute[70914]: INFO nova.compute.manager [None req-23d1280b-86c3-42b8-8f7c-8af53f2ed9ce tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Unrescuing
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-23d1280b-86c3-42b8-8f7c-8af53f2ed9ce tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-23d1280b-86c3-42b8-8f7c-8af53f2ed9ce tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquired lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-23d1280b-86c3-42b8-8f7c-8af53f2ed9ce tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:44 user nova-compute[70914]: INFO nova.compute.manager [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Rebooting instance
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquired lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:44:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:45 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:44:45 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7504MB free_disk=25.394733428955078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 30050776-6e41-487a-9ad2-342b18a7b72f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0371b280-fc39-4cbd-b496-ba78fea4e856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8897428a-7e38-49ed-9013-df0d2160196e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 617c1690-feaf-4158-be9c-bb53cb74d31f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updating instance_info_cache with network_info: [{"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Releasing lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-23d1280b-86c3-42b8-8f7c-8af53f2ed9ce tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updating instance_info_cache with network_info: [{"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-23d1280b-86c3-42b8-8f7c-8af53f2ed9ce tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Releasing lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG nova.objects.instance [None req-23d1280b-86c3-42b8-8f7c-8af53f2ed9ce tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'flavor' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-120ae158-17b1-4e04-974c-b9047a0bb591 req-2eb0fa20-07df-42a5-b5b6-6a797d5988c0 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-vif-unplugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-120ae158-17b1-4e04-974c-b9047a0bb591 req-2eb0fa20-07df-42a5-b5b6-6a797d5988c0 service nova] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-120ae158-17b1-4e04-974c-b9047a0bb591 req-2eb0fa20-07df-42a5-b5b6-6a797d5988c0 service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-120ae158-17b1-4e04-974c-b9047a0bb591 req-2eb0fa20-07df-42a5-b5b6-6a797d5988c0 service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-120ae158-17b1-4e04-974c-b9047a0bb591 req-2eb0fa20-07df-42a5-b5b6-6a797d5988c0 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] No waiting events found dispatching network-vif-unplugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:46 user nova-compute[70914]: WARNING nova.compute.manager [req-120ae158-17b1-4e04-974c-b9047a0bb591 req-2eb0fa20-07df-42a5-b5b6-6a797d5988c0 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received unexpected event network-vif-unplugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 13:44:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-735236f4-7ef0-475a-a281-c2d77d268f59 req-7fa43cac-a261-41c4-969c-b5bfcc1066a4 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-unplugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-735236f4-7ef0-475a-a281-c2d77d268f59 req-7fa43cac-a261-41c4-969c-b5bfcc1066a4 service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-735236f4-7ef0-475a-a281-c2d77d268f59 req-7fa43cac-a261-41c4-969c-b5bfcc1066a4 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-735236f4-7ef0-475a-a281-c2d77d268f59 req-7fa43cac-a261-41c4-969c-b5bfcc1066a4 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-735236f4-7ef0-475a-a281-c2d77d268f59 req-7fa43cac-a261-41c4-969c-b5bfcc1066a4 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-unplugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:46 user nova-compute[70914]: WARNING nova.compute.manager [req-735236f4-7ef0-475a-a281-c2d77d268f59 req-7fa43cac-a261-41c4-969c-b5bfcc1066a4 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-unplugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:44:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:46 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Instance destroyed successfully.
Jul 27 13:44:46 user nova-compute[70914]: DEBUG nova.objects.instance [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'resources' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-948322511',display_name='tempest-TestMinimumBasicScenario-server-948322511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-948322511',id=23,image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKgwFRMqg++F6VMttGQOMCdPQ6K0qJzfmdZXVdMWuv9ZYlvkJksIbxDMMfuJdggMi0iYxooQuba5bDy2He7DNtQCGSRS8ITcsjdGfcwf3G6wCYY0GYn+GWFDcsPlWjFug==',key_name='tempest-TestMinimumBasicScenario-2060879644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45941da6cb4b3a8c7394cc649e62e5',ramdisk_id='',reservation_id='r-377gj72q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-779682044',owner_user_name='tempest-TestMinimumBasicScenario-779682044-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:44:46Z,user_data=None,user_id='340b2ab1e12b4e0491b86f3eb2596cd1',uuid=0371b280-fc39-4cbd-b496-ba78fea4e856,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converting VIF {"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG os_vif [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4252cbc5-88, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:46 user nova-compute[70914]: INFO os_vif [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88')
Jul 27 13:44:46 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Instance destroyed successfully.
Jul 27 13:44:46 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZsyQJeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:44:46 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:44:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a2a5e-a9f0-4c0f-b62d-172f98e1d7cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:44:46 user nova-compute[70914]: No targets found.
Jul 27 13:44:46 user nova-compute[70914]: iSNS:
Jul 27 13:44:46 user nova-compute[70914]: No targets found.
Jul 27 13:44:46 user nova-compute[70914]: STATIC:
Jul 27 13:44:46 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188
Jul 27 13:44:46 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:44:46 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:44:46 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174
Jul 27 13:44:46 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:44:46 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:44:46 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:44:46 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:44:46 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:44:46 user nova-compute[70914]: FIRMWARE:
Jul 27 13:44:46 user nova-compute[70914]: No targets found.
Jul 27 13:44:46 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:44:46 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:44:46 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cc7056-310b-4412-a81a-cfc3c4127a4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1183d796-cb77-42eb-97c3-784312de20cd]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:47 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:47 user nova-compute[70914]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:44:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:47 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:47 user nova-compute[70914]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:44:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c1874a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ffb7e7-a43f-411c-8d7f-8c53d13c4afb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9ee896-eac0-48dc-bd1a-bb3eaa636765]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaa2493-f548-4613-846e-1fe70da1ee47]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d571b5f3-b014-4044-b231-e2d390220c32]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[207a3d19-1afb-4fdf-8053-2d79e2792c65]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d95f083-546a-4eda-bf23-8006e7b54383]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260]
Jul 27 13:44:47 user nova-compute[70914]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260] successful.
Jul 27 13:44:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfcdac4-fcc8-4727-8bb4-5d8d288a9aff]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] <== disconnect_volume: return (355ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Start _get_guest_xml network_info=[{"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=34c687af-4258-46da-8a45-5258a18fd9d1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '34c687af-4258-46da-8a45-5258a18fd9d1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '3e547cc7-6f7e-42d5-a5dd-04e4fc5f5fbb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZsyQJeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0371b280-fc39-4cbd-b496-ba78fea4e856', 'attached_at': '', 'detached_at': '', 'volume_id': '92a085ff-339a-4b95-a1fb-6ac855b1a188', 'serial': '92a085ff-339a-4b95-a1fb-6ac855b1a188'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:44:47 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:44:47 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=34c687af-4258-46da-8a45-5258a18fd9d1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.objects.instance [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZsyQJeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:44:47 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:44:47 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:44:47 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef73552-43b4-47c5-b693-167466f36065]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:44:47 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[421c8497-c001-403f-93a2-2c91ccbbf33e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188] added
Jul 27 13:44:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cc6e1b-c652-4c73-b30b-69df0c03d2d4]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac022c1c-d625-4484-9458-8f42f5b5993f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZsyQJeH {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZsyQJeH" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5ded20-47a5-477a-a30d-6cbfd7fb121d]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZsyQJeH'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c1f852-27e5-4bb5-aa30-9882c6390040]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[224a6a4f-b352-4ba6-b467-98e4145e7afb]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:47 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:47 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e8138a-154f-4017-bb25-ff2b7fafd943]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260]
Jul 27 13:44:47 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260] successful.
Jul 27 13:44:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eeb8cf-84f0-49c5-92eb-004c9553d465]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eef36b-e823-4f29-b9fe-15dec0c36e4a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:47 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:47 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:44:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:44:47 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:44:47 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:44:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf080e2-d037-455b-9795-9d1b1db53388]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZsyQJeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:44:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-2efc1b46-fe89-4fa2-aac3-802fe4eaf7f5 req-2752a6aa-25ea-478f-b2ae-1ae250161494 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2efc1b46-fe89-4fa2-aac3-802fe4eaf7f5 req-2752a6aa-25ea-478f-b2ae-1ae250161494 service nova] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2efc1b46-fe89-4fa2-aac3-802fe4eaf7f5 req-2752a6aa-25ea-478f-b2ae-1ae250161494 service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2efc1b46-fe89-4fa2-aac3-802fe4eaf7f5 req-2752a6aa-25ea-478f-b2ae-1ae250161494 service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-2efc1b46-fe89-4fa2-aac3-802fe4eaf7f5 req-2752a6aa-25ea-478f-b2ae-1ae250161494 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] No waiting events found dispatching network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:48 user nova-compute[70914]: WARNING nova.compute.manager [req-2efc1b46-fe89-4fa2-aac3-802fe4eaf7f5 req-2752a6aa-25ea-478f-b2ae-1ae250161494 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received unexpected event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 13:44:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-46af60b0-0399-428a-ad9a-2c20741ec4f8 req-d97dc679-6cc3-43f6-9a0b-94736cc55ec0 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-46af60b0-0399-428a-ad9a-2c20741ec4f8 req-d97dc679-6cc3-43f6-9a0b-94736cc55ec0 service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-46af60b0-0399-428a-ad9a-2c20741ec4f8 req-d97dc679-6cc3-43f6-9a0b-94736cc55ec0 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-46af60b0-0399-428a-ad9a-2c20741ec4f8 req-d97dc679-6cc3-43f6-9a0b-94736cc55ec0 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-46af60b0-0399-428a-ad9a-2c20741ec4f8 req-d97dc679-6cc3-43f6-9a0b-94736cc55ec0 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:48 user nova-compute[70914]: WARNING nova.compute.manager [req-46af60b0-0399-428a-ad9a-2c20741ec4f8 req-d97dc679-6cc3-43f6-9a0b-94736cc55ec0 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:44:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23437666334346337', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437666334346337', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-948322511',display_name='tempest-TestMinimumBasicScenario-server-948322511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-948322511',id=23,image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKgwFRMqg++F6VMttGQOMCdPQ6K0qJzfmdZXVdMWuv9ZYlvkJksIbxDMMfuJdggMi0iYxooQuba5bDy2He7DNtQCGSRS8ITcsjdGfcwf3G6wCYY0GYn+GWFDcsPlWjFug==',key_name='tempest-TestMinimumBasicScenario-2060879644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45941da6cb4b3a8c7394cc649e62e5',ramdisk_id='',reservation_id='r-377gj72q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-779682044',owner_user_name='tempest-TestMinimumBasicScenario-779682044-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:44:46Z,user_data=None,user_id='340b2ab1e12b4e0491b86f3eb2596cd1',uuid=0371b280-fc39-4cbd-b496-ba78fea4e856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converting VIF {"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.objects.instance [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'pci_devices' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:44:48 user nova-compute[70914]:   <uuid>0371b280-fc39-4cbd-b496-ba78fea4e856</uuid>
Jul 27 13:44:48 user nova-compute[70914]:   <name>instance-00000017</name>
Jul 27 13:44:48 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:44:48 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:44:48 user nova-compute[70914]:   <metadata>
Jul 27 13:44:48 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:44:48 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:44:48 user nova-compute[70914]:       <nova:name>tempest-TestMinimumBasicScenario-server-948322511</nova:name>
Jul 27 13:44:48 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:44:47</nova:creationTime>
Jul 27 13:44:48 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:44:48 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:44:48 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:44:48 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:44:48 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:44:48 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:44:48 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:44:48 user nova-compute[70914]:       <nova:owner>
Jul 27 13:44:48 user nova-compute[70914]:         <nova:user uuid="340b2ab1e12b4e0491b86f3eb2596cd1">tempest-TestMinimumBasicScenario-779682044-project-member</nova:user>
Jul 27 13:44:48 user nova-compute[70914]:         <nova:project uuid="0b45941da6cb4b3a8c7394cc649e62e5">tempest-TestMinimumBasicScenario-779682044</nova:project>
Jul 27 13:44:48 user nova-compute[70914]:       </nova:owner>
Jul 27 13:44:48 user nova-compute[70914]:       <nova:root type="image" uuid="34c687af-4258-46da-8a45-5258a18fd9d1"/>
Jul 27 13:44:48 user nova-compute[70914]:       <nova:ports>
Jul 27 13:44:48 user nova-compute[70914]:         <nova:port uuid="4252cbc5-88bf-446c-abdb-46c174a0afa6">
Jul 27 13:44:48 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 13:44:48 user nova-compute[70914]:         </nova:port>
Jul 27 13:44:48 user nova-compute[70914]:       </nova:ports>
Jul 27 13:44:48 user nova-compute[70914]:     </nova:instance>
Jul 27 13:44:48 user nova-compute[70914]:   </metadata>
Jul 27 13:44:48 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:44:48 user nova-compute[70914]:     <system>
Jul 27 13:44:48 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:44:48 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:44:48 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:44:48 user nova-compute[70914]:       <entry name="serial">0371b280-fc39-4cbd-b496-ba78fea4e856</entry>
Jul 27 13:44:48 user nova-compute[70914]:       <entry name="uuid">0371b280-fc39-4cbd-b496-ba78fea4e856</entry>
Jul 27 13:44:48 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:44:48 user nova-compute[70914]:     </system>
Jul 27 13:44:48 user nova-compute[70914]:   </sysinfo>
Jul 27 13:44:48 user nova-compute[70914]:   <os>
Jul 27 13:44:48 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:44:48 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:44:48 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:44:48 user nova-compute[70914]:   </os>
Jul 27 13:44:48 user nova-compute[70914]:   <features>
Jul 27 13:44:48 user nova-compute[70914]:     <acpi/>
Jul 27 13:44:48 user nova-compute[70914]:     <apic/>
Jul 27 13:44:48 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:44:48 user nova-compute[70914]:   </features>
Jul 27 13:44:48 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:44:48 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:44:48 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:44:48 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:44:48 user nova-compute[70914]:   </clock>
Jul 27 13:44:48 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:44:48 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:44:48 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:44:48 user nova-compute[70914]:   </cpu>
Jul 27 13:44:48 user nova-compute[70914]:   <devices>
Jul 27 13:44:48 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:44:48 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:44:48 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk"/>
Jul 27 13:44:48 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:44:48 user nova-compute[70914]:     </disk>
Jul 27 13:44:48 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:44:48 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:44:48 user nova-compute[70914]:       <source dev="/dev/sdb"/>
Jul 27 13:44:48 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:44:48 user nova-compute[70914]:       <serial>92a085ff-339a-4b95-a1fb-6ac855b1a188</serial>
Jul 27 13:44:48 user nova-compute[70914]:     </disk>
Jul 27 13:44:48 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:44:48 user nova-compute[70914]:       <mac address="fa:16:3e:ff:b5:23"/>
Jul 27 13:44:48 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:44:48 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:44:48 user nova-compute[70914]:       <target dev="tap4252cbc5-88"/>
Jul 27 13:44:48 user nova-compute[70914]:     </interface>
Jul 27 13:44:48 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:44:48 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/console.log" append="off"/>
Jul 27 13:44:48 user nova-compute[70914]:     </serial>
Jul 27 13:44:48 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:44:48 user nova-compute[70914]:     <video>
Jul 27 13:44:48 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:44:48 user nova-compute[70914]:     </video>
Jul 27 13:44:48 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:44:48 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:44:48 user nova-compute[70914]:     </rng>
Jul 27 13:44:48 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:44:48 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:44:48 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:44:48 user nova-compute[70914]:     </memballoon>
Jul 27 13:44:48 user nova-compute[70914]:   </devices>
Jul 27 13:44:48 user nova-compute[70914]: </domain>
Jul 27 13:44:48 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG nova.objects.instance [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7 --force-share --output=json" returned: 0 in 0.206s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Cannot resize image /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG nova.objects.instance [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'migration_context' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-948322511',display_name='tempest-TestMinimumBasicScenario-server-948322511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-948322511',id=23,image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKgwFRMqg++F6VMttGQOMCdPQ6K0qJzfmdZXVdMWuv9ZYlvkJksIbxDMMfuJdggMi0iYxooQuba5bDy2He7DNtQCGSRS8ITcsjdGfcwf3G6wCYY0GYn+GWFDcsPlWjFug==',key_name='tempest-TestMinimumBasicScenario-2060879644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='0b45941da6cb4b3a8c7394cc649e62e5',ramdisk_id='',reservation_id='r-377gj72q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-779682044',owner_user_name='tempest-TestMinimumBasicScenario-779682044-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:44:46Z,user_data=None,user_id='340b2ab1e12b4e0491b86f3eb2596cd1',uuid=0371b280-fc39-4cbd-b496-ba78fea4e856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converting VIF {"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG os_vif [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4252cbc5-88, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4252cbc5-88, col_values=(('external_ids', {'iface-id': '4252cbc5-88bf-446c-abdb-46c174a0afa6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:b5:23', 'vm-uuid': '0371b280-fc39-4cbd-b496-ba78fea4e856'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:44:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:49 user nova-compute[70914]: INFO os_vif [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88')
Jul 27 13:44:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:50 user nova-compute[70914]: WARNING nova.compute.manager [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:50 user nova-compute[70914]: WARNING nova.compute.manager [req-aca7db8a-32a6-4e2f-84fa-7eae78ab7ebb req-5fb49973-ff45-4c9f-a7fb-354504dc4a76 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-23d1280b-86c3-42b8-8f7c-8af53f2ed9ce tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for 30050776-6e41-487a-9ad2-342b18a7b72f due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465490.7169683, 30050776-6e41-487a-9ad2-342b18a7b72f => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:44:50 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] VM Resumed (Lifecycle Event)
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-81a549d2-d1c6-4343-81fe-8d0ba0d7edba req-734d127e-e316-4f3b-86f0-58e68aa4b960 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received event network-changed-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-81a549d2-d1c6-4343-81fe-8d0ba0d7edba req-734d127e-e316-4f3b-86f0-58e68aa4b960 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Refreshing instance network info cache due to event network-changed-4024f41b-83a0-42dd-9c21-71e5461c023f. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-81a549d2-d1c6-4343-81fe-8d0ba0d7edba req-734d127e-e316-4f3b-86f0-58e68aa4b960 service nova] Acquiring lock "refresh_cache-8897428a-7e38-49ed-9013-df0d2160196e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-81a549d2-d1c6-4343-81fe-8d0ba0d7edba req-734d127e-e316-4f3b-86f0-58e68aa4b960 service nova] Acquired lock "refresh_cache-8897428a-7e38-49ed-9013-df0d2160196e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.network.neutron [req-81a549d2-d1c6-4343-81fe-8d0ba0d7edba req-734d127e-e316-4f3b-86f0-58e68aa4b960 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Refreshing network info cache for port 4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:44:50 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465490.7180188, 30050776-6e41-487a-9ad2-342b18a7b72f => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:44:50 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] VM Started (Lifecycle Event)
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-7e431510-6365-40fa-a328-eae210c0219d req-13a4f24c-23fc-4561-919f-cf09f3a85e60 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7e431510-6365-40fa-a328-eae210c0219d req-13a4f24c-23fc-4561-919f-cf09f3a85e60 service nova] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7e431510-6365-40fa-a328-eae210c0219d req-13a4f24c-23fc-4561-919f-cf09f3a85e60 service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7e431510-6365-40fa-a328-eae210c0219d req-13a4f24c-23fc-4561-919f-cf09f3a85e60 service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-7e431510-6365-40fa-a328-eae210c0219d req-13a4f24c-23fc-4561-919f-cf09f3a85e60 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] No waiting events found dispatching network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:51 user nova-compute[70914]: WARNING nova.compute.manager [req-7e431510-6365-40fa-a328-eae210c0219d req-13a4f24c-23fc-4561-919f-cf09f3a85e60 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received unexpected event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 13:44:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-81a549d2-d1c6-4343-81fe-8d0ba0d7edba req-734d127e-e316-4f3b-86f0-58e68aa4b960 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Updated VIF entry in instance network info cache for port 4024f41b-83a0-42dd-9c21-71e5461c023f. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:44:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-81a549d2-d1c6-4343-81fe-8d0ba0d7edba req-734d127e-e316-4f3b-86f0-58e68aa4b960 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Updating instance_info_cache with network_info: [{"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:44:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-81a549d2-d1c6-4343-81fe-8d0ba0d7edba req-734d127e-e316-4f3b-86f0-58e68aa4b960 service nova] Releasing lock "refresh_cache-8897428a-7e38-49ed-9013-df0d2160196e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for 0371b280-fc39-4cbd-b496-ba78fea4e856 due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465493.29683, 0371b280-fc39-4cbd-b496-ba78fea4e856 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:44:53 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] VM Resumed (Lifecycle Event)
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:44:53 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Instance rebooted successfully.
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:44:53 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465493.299201, 0371b280-fc39-4cbd-b496-ba78fea4e856 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:44:53 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] VM Started (Lifecycle Event)
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-18ac41b5-6ba0-4740-9114-71a76a3ef55d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.862s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fc2ab02f-7dbc-476e-8c56-3d5a9e1c413b req-7e56c0e3-7f9a-4cd5-9ab2-24b5e7c17d2b service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fc2ab02f-7dbc-476e-8c56-3d5a9e1c413b req-7e56c0e3-7f9a-4cd5-9ab2-24b5e7c17d2b service nova] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fc2ab02f-7dbc-476e-8c56-3d5a9e1c413b req-7e56c0e3-7f9a-4cd5-9ab2-24b5e7c17d2b service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fc2ab02f-7dbc-476e-8c56-3d5a9e1c413b req-7e56c0e3-7f9a-4cd5-9ab2-24b5e7c17d2b service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-fc2ab02f-7dbc-476e-8c56-3d5a9e1c413b req-7e56c0e3-7f9a-4cd5-9ab2-24b5e7c17d2b service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] No waiting events found dispatching network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:53 user nova-compute[70914]: WARNING nova.compute.manager [req-fc2ab02f-7dbc-476e-8c56-3d5a9e1c413b req-7e56c0e3-7f9a-4cd5-9ab2-24b5e7c17d2b service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received unexpected event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 for instance with vm_state active and task_state None.
Jul 27 13:44:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:54 user nova-compute[70914]: DEBUG nova.objects.instance [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:55 user nova-compute[70914]: INFO nova.compute.manager [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Attaching volume 6874e9fb-29e6-45ed-859e-5542762172d7 to /dev/vdb
Jul 27 13:44:55 user nova-compute[70914]: DEBUG os_brick.utils [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7935a3-479b-453a-b2ca-5c2c7c3fab5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "617c1690-feaf-4158-be9c-bb53cb74d31f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:55 user nova-compute[70914]: INFO nova.compute.manager [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Terminating instance
Jul 27 13:44:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c576e8d-9aae-4574-be16-9464a4ae308b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9350160-dc51-470d-876f-f66a3a915dc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1876109c-ab26-4adc-aef6-f7523c59c2e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:44:55 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3345da-306d-4482-8cb2-65bf439b0686]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG os_brick.utils [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Updating existing volume attachment record: 02ba52fd-a3de-48dd-be48-9d6a706ce2df {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-aef29900-f5d5-42e1-90b8-0c82684dcb60 req-58ca3ce2-4b0f-4afd-9366-996a9ba3f5af service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Received event network-vif-unplugged-1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aef29900-f5d5-42e1-90b8-0c82684dcb60 req-58ca3ce2-4b0f-4afd-9366-996a9ba3f5af service nova] Acquiring lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aef29900-f5d5-42e1-90b8-0c82684dcb60 req-58ca3ce2-4b0f-4afd-9366-996a9ba3f5af service nova] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aef29900-f5d5-42e1-90b8-0c82684dcb60 req-58ca3ce2-4b0f-4afd-9366-996a9ba3f5af service nova] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-aef29900-f5d5-42e1-90b8-0c82684dcb60 req-58ca3ce2-4b0f-4afd-9366-996a9ba3f5af service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] No waiting events found dispatching network-vif-unplugged-1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-aef29900-f5d5-42e1-90b8-0c82684dcb60 req-58ca3ce2-4b0f-4afd-9366-996a9ba3f5af service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Received event network-vif-unplugged-1d5a6186-4f09-4030-b47f-d13117b7310a for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:44:55 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Instance destroyed successfully.
Jul 27 13:44:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lazy-loading 'resources' on Instance uuid 617c1690-feaf-4158-be9c-bb53cb74d31f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-203608085',display_name='tempest-VolumesActionsTest-instance-203608085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-203608085',id=26,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:43:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bca794885b0f49cf84038cd7c3edf9ee',ramdisk_id='',reservation_id='r-5jg9les4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1110307362',owner_user_name='tempest-VolumesActionsTest-1110307362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:43:12Z,user_data=None,user_id='52e4c423609f4481b1634fbaca3e7ddb',uuid=617c1690-feaf-4158-be9c-bb53cb74d31f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d5a6186-4f09-4030-b47f-d13117b7310a", "address": "fa:16:3e:0d:4a:61", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d5a6186-4f", "ovs_interfaceid": "1d5a6186-4f09-4030-b47f-d13117b7310a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converting VIF {"id": "1d5a6186-4f09-4030-b47f-d13117b7310a", "address": "fa:16:3e:0d:4a:61", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d5a6186-4f", "ovs_interfaceid": "1d5a6186-4f09-4030-b47f-d13117b7310a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4a:61,bridge_name='br-int',has_traffic_filtering=True,id=1d5a6186-4f09-4030-b47f-d13117b7310a,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d5a6186-4f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG os_vif [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4a:61,bridge_name='br-int',has_traffic_filtering=True,id=1d5a6186-4f09-4030-b47f-d13117b7310a,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d5a6186-4f') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d5a6186-4f, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:44:56 user nova-compute[70914]: INFO os_vif [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4a:61,bridge_name='br-int',has_traffic_filtering=True,id=1d5a6186-4f09-4030-b47f-d13117b7310a,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d5a6186-4f')
Jul 27 13:44:56 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Deleting instance files /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f_del
Jul 27 13:44:56 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Deletion of /opt/stack/data/nova/instances/617c1690-feaf-4158-be9c-bb53cb74d31f_del complete
Jul 27 13:44:56 user nova-compute[70914]: INFO nova.compute.manager [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 13:44:56 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:44:56 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Took 0.59 seconds to deallocate network for instance.
Jul 27 13:44:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:57 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:44:57 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:44:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:57 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Deleted allocations for instance 617c1690-feaf-4158-be9c-bb53cb74d31f
Jul 27 13:44:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-641f0bef-7c27-4eee-850c-e8d087b6e6ee tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.147s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4633cad-ca8f-4f91-bed4-a4850f073a50 req-ef3dba12-08c2-4b4b-b8ad-7be38f2071e2 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Received event network-vif-plugged-1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4633cad-ca8f-4f91-bed4-a4850f073a50 req-ef3dba12-08c2-4b4b-b8ad-7be38f2071e2 service nova] Acquiring lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:44:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4633cad-ca8f-4f91-bed4-a4850f073a50 req-ef3dba12-08c2-4b4b-b8ad-7be38f2071e2 service nova] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:44:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a4633cad-ca8f-4f91-bed4-a4850f073a50 req-ef3dba12-08c2-4b4b-b8ad-7be38f2071e2 service nova] Lock "617c1690-feaf-4158-be9c-bb53cb74d31f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:44:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4633cad-ca8f-4f91-bed4-a4850f073a50 req-ef3dba12-08c2-4b4b-b8ad-7be38f2071e2 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] No waiting events found dispatching network-vif-plugged-1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:44:57 user nova-compute[70914]: WARNING nova.compute.manager [req-a4633cad-ca8f-4f91-bed4-a4850f073a50 req-ef3dba12-08c2-4b4b-b8ad-7be38f2071e2 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Received unexpected event network-vif-plugged-1d5a6186-4f09-4030-b47f-d13117b7310a for instance with vm_state deleted and task_state None.
Jul 27 13:44:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-a4633cad-ca8f-4f91-bed4-a4850f073a50 req-ef3dba12-08c2-4b4b-b8ad-7be38f2071e2 service nova] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Received event network-vif-deleted-1d5a6186-4f09-4030-b47f-d13117b7310a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:44:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:02 user nova-compute[70914]: INFO nova.compute.manager [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Rescuing
Jul 27 13:45:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:45:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquired lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:45:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sDohHFMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:45:03 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:45:03 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:45:03 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c09ed6-5e68-49dc-b662-fa26c22e252a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:45:03 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94ef22f-80ec-4735-8f3f-98281738a103]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7] added
Jul 27 13:45:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfd169d-d1c4-4dd8-86cf-6551f1eaf631]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9be924-9fd7-4bb0-88d3-4bdbd99b8053]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sDohHFMb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sDohHFMb" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9c1c77-9d1b-4968-9814-45476ad5f7ef]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sDohHFMb'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd3e137-2ec3-4021-a827-8fa3b6a963af]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba59d8a-8456-467e-afc5-47edc2dddc83]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:03 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:03 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:03 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:03 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updating instance_info_cache with network_info: [{"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e8f2b2-af5d-428d-aac0-a4734c6a5b3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7, portal: 172.16.0.220,3260]
Jul 27 13:45:03 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7, portal: 172.16.0.220,3260] successful.
Jul 27 13:45:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Releasing lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48da190-ec67-4b1b-96f1-d01f36def78b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd8fabf-9b37-455e-aa01-617d8620074a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:03 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:03 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:03 user nova-compute[70914]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)
Jul 27 13:45:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:03 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:03 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:03 user nova-compute[70914]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)
Jul 27 13:45:03 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f4e14f-0551-4c08-975d-05a93f13cb30]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sDohHFMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-67366b57-7b99-4890-b46d-cd790143d36f req-40367f8e-bfbc-4e83-9ba4-bbe2f0d7fd41 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-unplugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-67366b57-7b99-4890-b46d-cd790143d36f req-40367f8e-bfbc-4e83-9ba4-bbe2f0d7fd41 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-67366b57-7b99-4890-b46d-cd790143d36f req-40367f8e-bfbc-4e83-9ba4-bbe2f0d7fd41 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-67366b57-7b99-4890-b46d-cd790143d36f req-40367f8e-bfbc-4e83-9ba4-bbe2f0d7fd41 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-67366b57-7b99-4890-b46d-cd790143d36f req-40367f8e-bfbc-4e83-9ba4-bbe2f0d7fd41 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-unplugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:45:03 user nova-compute[70914]: WARNING nova.compute.manager [req-67366b57-7b99-4890-b46d-cd790143d36f req-40367f8e-bfbc-4e83-9ba4-bbe2f0d7fd41 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-unplugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state active and task_state rescuing.
Jul 27 13:45:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:04 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Instance destroyed successfully.
Jul 27 13:45:04 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Attempting a stable device rescue
Jul 27 13:45:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70914) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 13:45:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Instance directory exists: not creating {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 13:45:04 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Creating image(s)
Jul 27 13:45:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "/opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "/opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "/opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:04 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'trusted_certs' on Instance uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "5d299d048935c1910c319d1020c1975af533ac5f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "5d299d048935c1910c319d1020c1975af533ac5f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f.part --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.560s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== connect_volume: return (2563ms) {'type': 'block', 'scsi_wwn': '26234633332666336', 'path': '/dev/sde'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234633332666336', 'path': '/dev/sde'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG nova.objects.instance [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:45:05 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:45:05 user nova-compute[70914]:   <source dev="/dev/sde"/>
Jul 27 13:45:05 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:45:05 user nova-compute[70914]:   <serial>6874e9fb-29e6-45ed-859e-5542762172d7</serial>
Jul 27 13:45:05 user nova-compute[70914]: </disk>
Jul 27 13:45:05 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f.part --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG nova.virt.images [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] bb39b28a-2384-430e-8a7f-93007fcb17e5 was qcow2, converting to raw {{(pid=70914) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f.part /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f.converted {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-70ccb2b1-7a32-4c81-9c6d-fe326f1e9c36 req-23793b83-660e-42e7-a7d6-1475e9b14aae service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70ccb2b1-7a32-4c81-9c6d-fe326f1e9c36 req-23793b83-660e-42e7-a7d6-1475e9b14aae service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70ccb2b1-7a32-4c81-9c6d-fe326f1e9c36 req-23793b83-660e-42e7-a7d6-1475e9b14aae service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-70ccb2b1-7a32-4c81-9c6d-fe326f1e9c36 req-23793b83-660e-42e7-a7d6-1475e9b14aae service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-70ccb2b1-7a32-4c81-9c6d-fe326f1e9c36 req-23793b83-660e-42e7-a7d6-1475e9b14aae service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:45:05 user nova-compute[70914]: WARNING nova.compute.manager [req-70ccb2b1-7a32-4c81-9c6d-fe326f1e9c36 req-23793b83-660e-42e7-a7d6-1475e9b14aae service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state active and task_state rescuing.
Jul 27 13:45:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f.part /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f.converted" returned: 0 in 0.306s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f.converted --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No VIF found with MAC fa:16:3e:fb:2e:9f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "5d299d048935c1910c319d1020c1975af533ac5f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.852s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "5d299d048935c1910c319d1020c1975af533ac5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "5d299d048935c1910c319d1020c1975af533ac5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bc17de0f-d027-46c4-b257-7b0d9f5bf954 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.356s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f,backing_fmt=raw /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f,backing_fmt=raw /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue" returned: 0 in 0.053s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "5d299d048935c1910c319d1020c1975af533ac5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'migration_context' on Instance uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Start _get_guest_xml network_info=[{"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "vif_mac": "fa:16:3e:9a:cb:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb39b28a-2384-430e-8a7f-93007fcb17e5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'f6e2061d-45ff-4c5c-a042-799b1fb2bf13', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAqoEYwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '45a01fa6-81c7-4f78-83a8-83fb11cdb1cc', 'attached_at': '', 'detached_at': '', 'volume_id': '1450a005-ef4f-4fc8-a2a2-6920e8f921bc', 'serial': '1450a005-ef4f-4fc8-a2a2-6920e8f921bc'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'resources' on Instance uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'numa_topology' on Instance uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:06 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:45:06 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'vcpu_model' on Instance uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAqoEYwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:45:06 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:45:06 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:45:06 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0874a95-a404-4a8a-80b5-9cb2f9e11548]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nAqoEYwN\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 13:45:06 user nova-compute[70914]: node.name = iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:45:06 user nova-compute[70914]: node.tpgt = -1
Jul 27 13:45:06 user nova-compute[70914]: node.startup = automatic
Jul 27 13:45:06 user nova-compute[70914]: node.leading_login = No
Jul 27 13:45:06 user nova-compute[70914]: iface.iscsi_ifacename = default
Jul 27 13:45:06 user nova-compute[70914]: iface.net_ifacename = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.ipaddress = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.prefix_len = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.hwaddress = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.transport_name = tcp
Jul 27 13:45:06 user nova-compute[70914]: iface.initiatorname = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.state = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.vlan_id = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.vlan_priority = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.vlan_state = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.iface_num = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.mtu = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.port = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.bootproto = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.subnet_mask = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.gateway = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.dhcp_alt_client_id = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.dhcp_dns = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.dhcp_learn_iqn = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.dhcp_vendor_id_state = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.dhcp_vendor_id = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.dhcp_slp_da = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.fragmentation = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.gratuitous_arp = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.incoming_forwarding = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.tos_state = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.tos = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.ttl = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.delayed_ack = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.tcp_nagle = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.tcp_wsf_state = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.tcp_wsf = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.tcp_timer_scale = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.tcp_timestamp = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.redirect = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.def_task_mgmt_timeout = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.header_digest = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.data_digest = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.immediate_data = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.initial_r2t = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.data_seq_inorder = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.data_pdu_inorder = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.erl = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.max_receive_data_len = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.first_burst_len = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.max_outstanding_r2t = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.max_burst_len = 0
Jul 27 13:45:06 user nova-compute[70914]: iface.chap_auth = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.bidi_chap = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.strict_login_compliance = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.discovery_auth = <empty>
Jul 27 13:45:06 user nova-compute[70914]: iface.discovery_logout = <empty>
Jul 27 13:45:06 user nova-compute[70914]: node.discovery_address = <empty>
Jul 27 13:45:06 user nova-compute[70914]: node.discovery_port = 0
Jul 27 13:45:06 user nova-compute[70914]: node.discovery_type = static
Jul 27 13:45:06 user nova-compute[70914]: node.session.initial_cmdsn = 0
Jul 27 13:45:06 user nova-compute[70914]: node.session.initial_login_retry_max = 8
Jul 27 13:45:06 user nova-compute[70914]: node.session.xmit_thread_priority = -20
Jul 27 13:45:06 user nova-compute[70914]: node.session.cmds_max = 128
Jul 27 13:45:06 user nova-compute[70914]: node.session.queue_depth = 32
Jul 27 13:45:06 user nova-compute[70914]: node.session.nr_sessions = 1
Jul 27 13:45:06 user nova-compute[70914]: node.session.auth.authmethod = CHAP
Jul 27 13:45:06 user nova-compute[70914]: node.session.auth.username = nAqoEYwN
Jul 27 13:45:06 user nova-compute[70914]: node.session.auth.password = ***
Jul 27 13:45:06 user nova-compute[70914]: node.session.auth.username_in = <empty>
Jul 27 13:45:06 user nova-compute[70914]: node.session.auth.password_in = <empty>
Jul 27 13:45:06 user nova-compute[70914]: node.session.auth.chap_algs = MD5
Jul 27 13:45:06 user nova-compute[70914]: node.session.timeo.replacement_timeout = 120
Jul 27 13:45:06 user nova-compute[70914]: node.session.err_timeo.abort_timeout = 15
Jul 27 13:45:06 user nova-compute[70914]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 13:45:06 user nova-compute[70914]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 13:45:06 user nova-compute[70914]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 13:45:06 user nova-compute[70914]: node.session.iscsi.FastAbort = Yes
Jul 27 13:45:06 user nova-compute[70914]: node.session.iscsi.InitialR2T = No
Jul 27 13:45:06 user nova-compute[70914]: node.session.iscsi.ImmediateData = Yes
Jul 27 13:45:06 user nova-compute[70914]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 13:45:06 user nova-compute[70914]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 13:45:06 user nova-compute[70914]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 13:45:06 user nova-compute[70914]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 13:45:06 user nova-compute[70914]: node.session.iscsi.MaxConnections = 1
Jul 27 13:45:06 user nova-compute[70914]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 13:45:06 user nova-compute[70914]: node.session.iscsi.ERL = 0
Jul 27 13:45:06 user nova-compute[70914]: node.session.scan = manual
Jul 27 13:45:06 user nova-compute[70914]: node.session.reopen_max = 0
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].address = 172.16.0.220
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].port = 3260
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].startup = manual
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].tcp.window_size = 524288
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].tcp.type_of_service = 0
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].timeo.logout_timeout = 15
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].timeo.login_timeout = 15
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].timeo.auth_timeout = 45
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].iscsi.DataDigest = None
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].iscsi.IFMarker = No
Jul 27 13:45:06 user nova-compute[70914]: node.conn[0].iscsi.OFMarker = No
Jul 27 13:45:06 user nova-compute[70914]: # END RECORD
Jul 27 13:45:06 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d494e6b8-adfe-42e4-b79d-1315a6d894d5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c88c240-ce86-4a0a-bc22-41fb679997d1]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAqoEYwN {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAqoEYwN" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3211e3d4-cd19-49ef-9a33-dc458b38644e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAqoEYwN'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27a8a9b-48e7-4562-92f6-73e5aaacc376]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[95711894-c997-491c-83e6-59caea7e1f19]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:06 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:06 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:06 user nova-compute[70914]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)
Jul 27 13:45:06 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:06 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:06 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:06 user nova-compute[70914]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)
Jul 27 13:45:06 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] HCTL ('34', '0', '0', 0) found on session 31 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c017f0-3c5d-41b0-a31d-b9d4323230b5]: (4, ('0 0 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching for a device in session 31 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAqoEYwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '23839313632316434', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839313632316434', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-31353135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-31353135',id=27,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:43:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-bbhk20d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:43:31Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=45a01fa6-81c7-4f78-83a8-83fb11cdb1cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "vif_mac": "fa:16:3e:9a:cb:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "vif_mac": "fa:16:3e:9a:cb:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:cb:32,bridge_name='br-int',has_traffic_filtering=True,id=0976e6f9-568a-42b8-8b0e-b135d2203749,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976e6f9-56') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'pci_devices' on Instance uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:45:06 user nova-compute[70914]:   <uuid>45a01fa6-81c7-4f78-83a8-83fb11cdb1cc</uuid>
Jul 27 13:45:06 user nova-compute[70914]:   <name>instance-0000001b</name>
Jul 27 13:45:06 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:45:06 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:45:06 user nova-compute[70914]:   <metadata>
Jul 27 13:45:06 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:45:06 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:45:06 user nova-compute[70914]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-31353135</nova:name>
Jul 27 13:45:06 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:45:06</nova:creationTime>
Jul 27 13:45:06 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:45:06 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:45:06 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:45:06 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:45:06 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:45:06 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:45:06 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:45:06 user nova-compute[70914]:       <nova:owner>
Jul 27 13:45:06 user nova-compute[70914]:         <nova:user uuid="89bc44e787074838ba46afd3f81262f0">tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member</nova:user>
Jul 27 13:45:06 user nova-compute[70914]:         <nova:project uuid="e9647080d1194d60aeb390b127895474">tempest-ServerBootFromVolumeStableRescueTest-853279030</nova:project>
Jul 27 13:45:06 user nova-compute[70914]:       </nova:owner>
Jul 27 13:45:06 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:45:06 user nova-compute[70914]:       <nova:ports>
Jul 27 13:45:06 user nova-compute[70914]:         <nova:port uuid="0976e6f9-568a-42b8-8b0e-b135d2203749">
Jul 27 13:45:06 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 13:45:06 user nova-compute[70914]:         </nova:port>
Jul 27 13:45:06 user nova-compute[70914]:       </nova:ports>
Jul 27 13:45:06 user nova-compute[70914]:     </nova:instance>
Jul 27 13:45:06 user nova-compute[70914]:   </metadata>
Jul 27 13:45:06 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:45:06 user nova-compute[70914]:     <system>
Jul 27 13:45:06 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:45:06 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:45:06 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:45:06 user nova-compute[70914]:       <entry name="serial">45a01fa6-81c7-4f78-83a8-83fb11cdb1cc</entry>
Jul 27 13:45:06 user nova-compute[70914]:       <entry name="uuid">45a01fa6-81c7-4f78-83a8-83fb11cdb1cc</entry>
Jul 27 13:45:06 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:45:06 user nova-compute[70914]:     </system>
Jul 27 13:45:06 user nova-compute[70914]:   </sysinfo>
Jul 27 13:45:06 user nova-compute[70914]:   <os>
Jul 27 13:45:06 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:45:06 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:45:06 user nova-compute[70914]:   </os>
Jul 27 13:45:06 user nova-compute[70914]:   <features>
Jul 27 13:45:06 user nova-compute[70914]:     <acpi/>
Jul 27 13:45:06 user nova-compute[70914]:     <apic/>
Jul 27 13:45:06 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:45:06 user nova-compute[70914]:   </features>
Jul 27 13:45:06 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:45:06 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:45:06 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:45:06 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:45:06 user nova-compute[70914]:   </clock>
Jul 27 13:45:06 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:45:06 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:45:06 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:45:06 user nova-compute[70914]:   </cpu>
Jul 27 13:45:06 user nova-compute[70914]:   <devices>
Jul 27 13:45:06 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:45:06 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:45:06 user nova-compute[70914]:       <source dev="/dev/sdc"/>
Jul 27 13:45:06 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:45:06 user nova-compute[70914]:       <serial>1450a005-ef4f-4fc8-a2a2-6920e8f921bc</serial>
Jul 27 13:45:06 user nova-compute[70914]:     </disk>
Jul 27 13:45:06 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:45:06 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:45:06 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue"/>
Jul 27 13:45:06 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:45:06 user nova-compute[70914]:       <boot order="1"/>
Jul 27 13:45:06 user nova-compute[70914]:     </disk>
Jul 27 13:45:06 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:45:06 user nova-compute[70914]:       <mac address="fa:16:3e:9a:cb:32"/>
Jul 27 13:45:06 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:45:06 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:45:06 user nova-compute[70914]:       <target dev="tap0976e6f9-56"/>
Jul 27 13:45:06 user nova-compute[70914]:     </interface>
Jul 27 13:45:06 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:45:06 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/console.log" append="off"/>
Jul 27 13:45:06 user nova-compute[70914]:     </serial>
Jul 27 13:45:06 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:45:06 user nova-compute[70914]:     <video>
Jul 27 13:45:06 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:45:06 user nova-compute[70914]:     </video>
Jul 27 13:45:06 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:45:06 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:45:06 user nova-compute[70914]:     </rng>
Jul 27 13:45:06 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:45:06 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:45:06 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:45:06 user nova-compute[70914]:     </memballoon>
Jul 27 13:45:06 user nova-compute[70914]:   </devices>
Jul 27 13:45:06 user nova-compute[70914]: </domain>
Jul 27 13:45:06 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:45:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Instance destroyed successfully.
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:45:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No VIF found with MAC fa:16:3e:9a:cb:32, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:45:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-3eca403d-98e2-4e1d-b02e-d42e9f07bacc req-1528266e-9842-4a12-bbb9-17b5f70d4d33 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3eca403d-98e2-4e1d-b02e-d42e9f07bacc req-1528266e-9842-4a12-bbb9-17b5f70d4d33 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3eca403d-98e2-4e1d-b02e-d42e9f07bacc req-1528266e-9842-4a12-bbb9-17b5f70d4d33 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3eca403d-98e2-4e1d-b02e-d42e9f07bacc req-1528266e-9842-4a12-bbb9-17b5f70d4d33 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-3eca403d-98e2-4e1d-b02e-d42e9f07bacc req-1528266e-9842-4a12-bbb9-17b5f70d4d33 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:45:08 user nova-compute[70914]: WARNING nova.compute.manager [req-3eca403d-98e2-4e1d-b02e-d42e9f07bacc req-1528266e-9842-4a12-bbb9-17b5f70d4d33 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state active and task_state rescuing.
Jul 27 13:45:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-a5086ef9-72d0-4a11-8f2e-3b3abef6e6a3 req-5035681a-8bb2-4993-a943-8229335cad69 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a5086ef9-72d0-4a11-8f2e-3b3abef6e6a3 req-5035681a-8bb2-4993-a943-8229335cad69 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a5086ef9-72d0-4a11-8f2e-3b3abef6e6a3 req-5035681a-8bb2-4993-a943-8229335cad69 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a5086ef9-72d0-4a11-8f2e-3b3abef6e6a3 req-5035681a-8bb2-4993-a943-8229335cad69 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-a5086ef9-72d0-4a11-8f2e-3b3abef6e6a3 req-5035681a-8bb2-4993-a943-8229335cad69 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:45:10 user nova-compute[70914]: WARNING nova.compute.manager [req-a5086ef9-72d0-4a11-8f2e-3b3abef6e6a3 req-5035681a-8bb2-4993-a943-8229335cad69 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state active and task_state rescuing.
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465510.7029822, 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:45:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] VM Resumed (Lifecycle Event)
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3d410ecb-a285-4a97-bd64-7c4bb9ef07f9 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:45:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465510.7050865, 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:45:10 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] VM Started (Lifecycle Event)
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:10 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465495.9851415, 617c1690-feaf-4158-be9c-bb53cb74d31f => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:45:10 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] VM Stopped (Lifecycle Event)
Jul 27 13:45:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-214a4808-a750-46a3-8d58-c3b3e73dddb4 None None] [instance: 617c1690-feaf-4158-be9c-bb53cb74d31f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:11 user nova-compute[70914]: INFO nova.compute.manager [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Attaching volume d30b26f8-34b3-44ec-84b7-de6cc65e8dfb to /dev/vdc
Jul 27 13:45:11 user nova-compute[70914]: DEBUG os_brick.utils [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[498ba7f9-c220-4f45-936f-75f252c45fbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[56696858-b6c1-4f54-b8ba-508938d5c108]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5607e363-1853-43a3-ad5e-9edbe552906a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7893498-f848-4d6c-8ded-f6462b7bd6f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:45:11 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:45:11 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a77b3-5d54-472e-91e9-b4164765c872]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG os_brick.utils [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:45:11 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Updating existing volume attachment record: e6f3d69b-6d7c-403c-ac38-e6116e8c9b18 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:45:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBDAiEMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:45:18 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:45:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:45:18 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:45:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:45:18 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76c7ff3-be14-4026-8aab-9ed9e388fb1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:45:18 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1911213-c533-4a0f-843c-90f158210f65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb] added
Jul 27 13:45:18 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69ccd87-479c-41ee-8cdf-827d8de47a45]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e372ef-b2e4-4f02-b4e9-096eb05d4550]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBDAiEMv {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBDAiEMv" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[23407f63-df7c-43f7-a37b-e81d7d9637b5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KBDAiEMv'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9fcd4-983e-4a62-9f3f-481372f10704]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbebcff-341d-4c1f-b687-05c1b915a4da]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de2e347-04c1-4e5b-939f-f414bf0e60c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb, portal: 172.16.0.220,3260]
Jul 27 13:45:19 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb, portal: 172.16.0.220,3260] successful.
Jul 27 13:45:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c3e4c8-c8a7-4cbd-b28b-17c1134d9c67]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d937553d-7132-4f61-90b1-c5995102a288]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb (non-flash)
Jul 27 13:45:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)
Jul 27 13:45:19 user nova-compute[70914]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb (non-flash)
Jul 27 13:45:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a420daf-2464-4e22-8c79-ebd80ee7d549]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:45:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBDAiEMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:45:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:45:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26333303530323930', 'path': '/dev/sdf'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:45:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333303530323930', 'path': '/dev/sdf'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:45:20 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:45:20 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:45:20 user nova-compute[70914]:   <source dev="/dev/sdf"/>
Jul 27 13:45:20 user nova-compute[70914]:   <target dev="vdc" bus="virtio"/>
Jul 27 13:45:20 user nova-compute[70914]:   <serial>d30b26f8-34b3-44ec-84b7-de6cc65e8dfb</serial>
Jul 27 13:45:20 user nova-compute[70914]: </disk>
Jul 27 13:45:20 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:45:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:45:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:45:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:45:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] No VIF found with MAC fa:16:3e:fb:2e:9f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:45:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4f0a09c-e941-499e-ab3c-b6ba7831db01 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.837s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:22 user nova-compute[70914]: INFO nova.compute.manager [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Detaching volume 6874e9fb-29e6-45ed-859e-5542762172d7
Jul 27 13:45:22 user nova-compute[70914]: INFO nova.virt.block_device [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Attempting to driver detach volume 6874e9fb-29e6-45ed-859e-5542762172d7 from mountpoint /dev/vdb
Jul 27 13:45:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Attempting to detach device vdb from instance 8897428a-7e38-49ed-9013-df0d2160196e from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:45:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:45:22 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:45:22 user nova-compute[70914]:   <source dev="/dev/sde"/>
Jul 27 13:45:22 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:45:22 user nova-compute[70914]:   <serial>6874e9fb-29e6-45ed-859e-5542762172d7</serial>
Jul 27 13:45:22 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:45:22 user nova-compute[70914]: </disk>
Jul 27 13:45:22 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:45:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully detached device vdb from instance 8897428a-7e38-49ed-9013-df0d2160196e from the persistent domain config.
Jul 27 13:45:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8897428a-7e38-49ed-9013-df0d2160196e from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:45:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:45:22 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:45:22 user nova-compute[70914]:   <source dev="/dev/sde"/>
Jul 27 13:45:22 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:45:22 user nova-compute[70914]:   <serial>6874e9fb-29e6-45ed-859e-5542762172d7</serial>
Jul 27 13:45:22 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:45:22 user nova-compute[70914]: </disk>
Jul 27 13:45:22 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:45:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465522.9706023, 8897428a-7e38-49ed-9013-df0d2160196e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:45:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:45:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully detached device vdb from instance 8897428a-7e38-49ed-9013-df0d2160196e from the live domain config.
Jul 27 13:45:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:45:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sDohHFMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:45:22 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:45:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:45:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:45:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d1e16b-14c0-41a3-9a27-40120fa12d36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:45:23 user nova-compute[70914]: No targets found.
Jul 27 13:45:23 user nova-compute[70914]: iSNS:
Jul 27 13:45:23 user nova-compute[70914]: No targets found.
Jul 27 13:45:23 user nova-compute[70914]: STATIC:
Jul 27 13:45:23 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188
Jul 27 13:45:23 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:45:23 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:45:23 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174
Jul 27 13:45:23 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:45:23 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:45:23 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7
Jul 27 13:45:23 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:45:23 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:45:23 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:45:23 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:45:23 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:45:23 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb
Jul 27 13:45:23 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:45:23 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:45:23 user nova-compute[70914]: FIRMWARE:
Jul 27 13:45:23 user nova-compute[70914]: No targets found.
Jul 27 13:45:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:45:23 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:45:23 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b011d298-06c8-4572-8d3e-6385c489bb08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc383b78-9532-4347-a75e-d4f48956804d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:23 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:23 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:23 user nova-compute[70914]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)
Jul 27 13:45:23 user nova-compute[70914]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb (non-flash)
Jul 27 13:45:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:23 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:23 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:23 user nova-compute[70914]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 (non-flash)
Jul 27 13:45:23 user nova-compute[70914]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb (non-flash)
Jul 27 13:45:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18772200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7'): ({'sde'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Removing single pathed devices sde {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefa315e-7e02-4230-90a9-4cfb73762b45]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0cec9-92ca-4d95-a6d8-ac757ab2ad95]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flushing IO for device /dev/sde {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4948c60-fb95-48cb-a4e3-a95e94dbf2c5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cb51b9-3622-4152-af39-aee21172adf0]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[28049f58-1f88-49b1-ad0d-6f6432a68a5e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f6d8b1-8a1d-4f77-80e7-a49ad44055ff]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7, portal: 172.16.0.220,3260]
Jul 27 13:45:23 user nova-compute[70914]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7, portal: 172.16.0.220,3260] successful.
Jul 27 13:45:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6874e9fb-29e6-45ed-859e-5542762172d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[63262dbf-b5c0-4c0f-ad0a-32d7732452fc]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== disconnect_volume: return (397ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:45:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:45:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:24 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a13ec971-1f98-4076-84ef-5f3161051364 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.874s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:24 user nova-compute[70914]: INFO nova.compute.manager [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Detaching volume d30b26f8-34b3-44ec-84b7-de6cc65e8dfb
Jul 27 13:45:24 user nova-compute[70914]: INFO nova.virt.block_device [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Attempting to driver detach volume d30b26f8-34b3-44ec-84b7-de6cc65e8dfb from mountpoint /dev/vdc
Jul 27 13:45:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Attempting to detach device vdc from instance 8897428a-7e38-49ed-9013-df0d2160196e from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:45:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:45:24 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:45:24 user nova-compute[70914]:   <source dev="/dev/sdf"/>
Jul 27 13:45:24 user nova-compute[70914]:   <target dev="vdc" bus="virtio"/>
Jul 27 13:45:24 user nova-compute[70914]:   <serial>d30b26f8-34b3-44ec-84b7-de6cc65e8dfb</serial>
Jul 27 13:45:24 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 13:45:24 user nova-compute[70914]: </disk>
Jul 27 13:45:24 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:45:24 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully detached device vdc from instance 8897428a-7e38-49ed-9013-df0d2160196e from the persistent domain config.
Jul 27 13:45:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8897428a-7e38-49ed-9013-df0d2160196e from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:45:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:45:24 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:45:24 user nova-compute[70914]:   <source dev="/dev/sdf"/>
Jul 27 13:45:24 user nova-compute[70914]:   <target dev="vdc" bus="virtio"/>
Jul 27 13:45:24 user nova-compute[70914]:   <serial>d30b26f8-34b3-44ec-84b7-de6cc65e8dfb</serial>
Jul 27 13:45:24 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 13:45:24 user nova-compute[70914]: </disk>
Jul 27 13:45:24 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465525.4407992, 8897428a-7e38-49ed-9013-df0d2160196e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:45:25 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully detached device vdc from instance 8897428a-7e38-49ed-9013-df0d2160196e from the live domain config.
Jul 27 13:45:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBDAiEMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:45:25 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[233aebf7-80cf-4357-84bf-539bd239233b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:45:25 user nova-compute[70914]: No targets found.
Jul 27 13:45:25 user nova-compute[70914]: iSNS:
Jul 27 13:45:25 user nova-compute[70914]: No targets found.
Jul 27 13:45:25 user nova-compute[70914]: STATIC:
Jul 27 13:45:25 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188
Jul 27 13:45:25 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:45:25 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:45:25 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174
Jul 27 13:45:25 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:45:25 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:45:25 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:45:25 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:45:25 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:45:25 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb
Jul 27 13:45:25 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:45:25 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:45:25 user nova-compute[70914]: FIRMWARE:
Jul 27 13:45:25 user nova-compute[70914]: No targets found.
Jul 27 13:45:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:45:25 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:45:25 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f74a3c-b6d7-4b64-b709-ed9d50dc2200]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[df04da01-45a5-4776-81e7-3cb858802a2a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:25 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:25 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:25 user nova-compute[70914]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb (non-flash)
Jul 27 13:45:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:45:25 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:45:25 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:45:25 user nova-compute[70914]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb (non-flash)
Jul 27 13:45:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf875c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb'): ({'sdf'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Removing single pathed devices sdf {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[927fd9bb-a7e6-4af7-875f-863663204bd3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a4180-c666-451d-b87c-2640b722f31c]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Flushing IO for device /dev/sdf {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c3c955-a5c3-4b1d-ab3a-ee085ad61982]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc1118e-0a0f-4628-9c60-a77f4f1ea125]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] SCSI volumes sdf have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfe7bfa-f7aa-43ce-abc3-446fe50f97e7]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece934b4-745b-4b0a-b472-921d1bbc5454]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb, portal: 172.16.0.220,3260]
Jul 27 13:45:25 user nova-compute[70914]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb, portal: 172.16.0.220,3260] successful.
Jul 27 13:45:25 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b26f8-34b3-44ec-84b7-de6cc65e8dfb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[86601249-e002-433b-a090-ccb64c89a5ef]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] <== disconnect_volume: return (309ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:45:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:45:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'flavor' on Instance uuid 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-81427169-5e27-4672-8e0c-911b0a1d6ae2 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.829s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:27 user nova-compute[70914]: INFO nova.compute.manager [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Terminating instance
Jul 27 13:45:27 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG nova.compute.manager [req-2b00aae6-d180-490c-bd9e-1e468177f943 req-2981ee9f-8708-4d68-aff2-f4d7778331ab service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received event network-vif-unplugged-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2b00aae6-d180-490c-bd9e-1e468177f943 req-2981ee9f-8708-4d68-aff2-f4d7778331ab service nova] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2b00aae6-d180-490c-bd9e-1e468177f943 req-2981ee9f-8708-4d68-aff2-f4d7778331ab service nova] Lock "8897428a-7e38-49ed-9013-df0d2160196e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2b00aae6-d180-490c-bd9e-1e468177f943 req-2981ee9f-8708-4d68-aff2-f4d7778331ab service nova] Lock "8897428a-7e38-49ed-9013-df0d2160196e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG nova.compute.manager [req-2b00aae6-d180-490c-bd9e-1e468177f943 req-2981ee9f-8708-4d68-aff2-f4d7778331ab service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] No waiting events found dispatching network-vif-unplugged-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:45:27 user nova-compute[70914]: DEBUG nova.compute.manager [req-2b00aae6-d180-490c-bd9e-1e468177f943 req-2981ee9f-8708-4d68-aff2-f4d7778331ab service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received event network-vif-unplugged-4024f41b-83a0-42dd-9c21-71e5461c023f for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Instance destroyed successfully.
Jul 27 13:45:28 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lazy-loading 'resources' on Instance uuid 8897428a-7e38-49ed-9013-df0d2160196e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-506633269',display_name='tempest-AttachVolumeTestJSON-server-506633269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-506633269',id=25,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONLzy2VZHMJUnbb9oBSFj6OZy7pKFpC1QAVtth//OfJfC46sNk/5V+y6PGAJ93cW9gfz4KqtuhUvIA9DY+ZehZLXpr22OtFLPNmuuE6d2CFpu1HrC48UeEFXkM4PfG9tg==',key_name='tempest-keypair-991942898',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b9d12319d046088ca51fc23be9bb21',ramdisk_id='',reservation_id='r-ao2lzolk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-366868791',owner_user_name='tempest-AttachVolumeTestJSON-366868791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9e3e0bd86140ada9edb906a16e4784',uuid=8897428a-7e38-49ed-9013-df0d2160196e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converting VIF {"id": "4024f41b-83a0-42dd-9c21-71e5461c023f", "address": "fa:16:3e:fb:2e:9f", "network": {"id": "ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098083726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b9d12319d046088ca51fc23be9bb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024f41b-83", "ovs_interfaceid": "4024f41b-83a0-42dd-9c21-71e5461c023f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=4024f41b-83a0-42dd-9c21-71e5461c023f,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4024f41b-83') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG os_vif [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=4024f41b-83a0-42dd-9c21-71e5461c023f,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4024f41b-83') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4024f41b-83, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:45:28 user nova-compute[70914]: INFO os_vif [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=4024f41b-83a0-42dd-9c21-71e5461c023f,network=Network(ef1ee780-f9fc-4ead-82ed-3d7289a9bd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4024f41b-83')
Jul 27 13:45:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Deleting instance files /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e_del
Jul 27 13:45:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Deletion of /opt/stack/data/nova/instances/8897428a-7e38-49ed-9013-df0d2160196e_del complete
Jul 27 13:45:28 user nova-compute[70914]: INFO nova.compute.manager [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 13:45:28 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:45:28 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:45:29 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Took 1.02 seconds to deallocate network for instance.
Jul 27 13:45:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-8dccbbe8-ca01-497a-90dd-9561f3f82fc5 req-55f6b277-1554-472b-8a60-2c81bf15f30f service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received event network-vif-deleted-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:29 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Deleted allocations for instance 8897428a-7e38-49ed-9013-df0d2160196e
Jul 27 13:45:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-ff811a81-5eb4-41b1-b865-a5abb4a7c7e4 req-436f74ec-0504-4da6-80bb-b31e7208ab58 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received event network-vif-plugged-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ff811a81-5eb4-41b1-b865-a5abb4a7c7e4 req-436f74ec-0504-4da6-80bb-b31e7208ab58 service nova] Acquiring lock "8897428a-7e38-49ed-9013-df0d2160196e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ff811a81-5eb4-41b1-b865-a5abb4a7c7e4 req-436f74ec-0504-4da6-80bb-b31e7208ab58 service nova] Lock "8897428a-7e38-49ed-9013-df0d2160196e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ff811a81-5eb4-41b1-b865-a5abb4a7c7e4 req-436f74ec-0504-4da6-80bb-b31e7208ab58 service nova] Lock "8897428a-7e38-49ed-9013-df0d2160196e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-ff811a81-5eb4-41b1-b865-a5abb4a7c7e4 req-436f74ec-0504-4da6-80bb-b31e7208ab58 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] No waiting events found dispatching network-vif-plugged-4024f41b-83a0-42dd-9c21-71e5461c023f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:45:29 user nova-compute[70914]: WARNING nova.compute.manager [req-ff811a81-5eb4-41b1-b865-a5abb4a7c7e4 req-436f74ec-0504-4da6-80bb-b31e7208ab58 service nova] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Received unexpected event network-vif-plugged-4024f41b-83a0-42dd-9c21-71e5461c023f for instance with vm_state deleted and task_state None.
Jul 27 13:45:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3139f035-3819-4bba-8cdc-f67c106b45f1 tempest-AttachVolumeTestJSON-366868791 tempest-AttachVolumeTestJSON-366868791-project-member] Lock "8897428a-7e38-49ed-9013-df0d2160196e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:45:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:38 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:45:38 user nova-compute[70914]: INFO nova.compute.claims [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Claim successful on node user
Jul 27 13:45:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:45:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:45:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG nova.policy [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0d5277a420b42bfb40dfc0196fea575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c2842f73314df7b38893d27acf46e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:45:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Creating image(s)
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "/opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "/opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk 1073741824" returned: 0 in 0.068s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.163s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Successfully created port: c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Cannot resize image /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'migration_context' on Instance uuid cbf6d0ec-b91d-4db5-b863-156754c746bc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Ensure instance console log exists: /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Successfully updated port: c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "refresh_cache-cbf6d0ec-b91d-4db5-b863-156754c746bc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquired lock "refresh_cache-cbf6d0ec-b91d-4db5-b863-156754c746bc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:45:40 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-f833b88a-bb38-4e86-a719-596995a9837c req-99492ad5-c515-4a70-b147-22df5c3b6697 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-changed-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-f833b88a-bb38-4e86-a719-596995a9837c req-99492ad5-c515-4a70-b147-22df5c3b6697 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Refreshing instance network info cache due to event network-changed-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f833b88a-bb38-4e86-a719-596995a9837c req-99492ad5-c515-4a70-b147-22df5c3b6697 service nova] Acquiring lock "refresh_cache-cbf6d0ec-b91d-4db5-b863-156754c746bc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Updating instance_info_cache with network_info: [{"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Releasing lock "refresh_cache-cbf6d0ec-b91d-4db5-b863-156754c746bc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Instance network_info: |[{"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f833b88a-bb38-4e86-a719-596995a9837c req-99492ad5-c515-4a70-b147-22df5c3b6697 service nova] Acquired lock "refresh_cache-cbf6d0ec-b91d-4db5-b863-156754c746bc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-f833b88a-bb38-4e86-a719-596995a9837c req-99492ad5-c515-4a70-b147-22df5c3b6697 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Refreshing network info cache for port c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Start _get_guest_xml network_info=[{"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:45:41 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:45:41 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:45:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-644580012',display_name='tempest-VolumesSnapshotTestJSON-instance-644580012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-644580012',id=28,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNo5qJ+pKdNd63nJVYeexr/7s1uP5MLIjHcEEWV2oJMtLv1STTdDkX6Gk+GokxTCJMgMxGOdeMvGqfxPHBZ3/6TT85zUVqSVp95uGcMOGbOJ4QATR0nyyvrqXd2EXIE5Q==',key_name='tempest-keypair-1404813722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82c2842f73314df7b38893d27acf46e0',ramdisk_id='',reservation_id='r-0kdmaqnf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-277407372',owner_user_name='tempest-VolumesSnapshotTestJSON-277407372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:45:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0d5277a420b42bfb40dfc0196fea575',uuid=cbf6d0ec-b91d-4db5-b863-156754c746bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converting VIF {"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:7d:4f,bridge_name='br-int',has_traffic_filtering=True,id=c1ae2dfc-c734-4be9-bdd3-568940fbeb0a,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ae2dfc-c7') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'pci_devices' on Instance uuid cbf6d0ec-b91d-4db5-b863-156754c746bc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:45:41 user nova-compute[70914]:   <uuid>cbf6d0ec-b91d-4db5-b863-156754c746bc</uuid>
Jul 27 13:45:41 user nova-compute[70914]:   <name>instance-0000001c</name>
Jul 27 13:45:41 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:45:41 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:45:41 user nova-compute[70914]:   <metadata>
Jul 27 13:45:41 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:45:41 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:45:41 user nova-compute[70914]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-644580012</nova:name>
Jul 27 13:45:41 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:45:41</nova:creationTime>
Jul 27 13:45:41 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:45:41 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:45:41 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:45:41 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:45:41 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:45:41 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:45:41 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:45:41 user nova-compute[70914]:       <nova:owner>
Jul 27 13:45:41 user nova-compute[70914]:         <nova:user uuid="b0d5277a420b42bfb40dfc0196fea575">tempest-VolumesSnapshotTestJSON-277407372-project-member</nova:user>
Jul 27 13:45:41 user nova-compute[70914]:         <nova:project uuid="82c2842f73314df7b38893d27acf46e0">tempest-VolumesSnapshotTestJSON-277407372</nova:project>
Jul 27 13:45:41 user nova-compute[70914]:       </nova:owner>
Jul 27 13:45:41 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:45:41 user nova-compute[70914]:       <nova:ports>
Jul 27 13:45:41 user nova-compute[70914]:         <nova:port uuid="c1ae2dfc-c734-4be9-bdd3-568940fbeb0a">
Jul 27 13:45:41 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 13:45:41 user nova-compute[70914]:         </nova:port>
Jul 27 13:45:41 user nova-compute[70914]:       </nova:ports>
Jul 27 13:45:41 user nova-compute[70914]:     </nova:instance>
Jul 27 13:45:41 user nova-compute[70914]:   </metadata>
Jul 27 13:45:41 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:45:41 user nova-compute[70914]:     <system>
Jul 27 13:45:41 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:45:41 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:45:41 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:45:41 user nova-compute[70914]:       <entry name="serial">cbf6d0ec-b91d-4db5-b863-156754c746bc</entry>
Jul 27 13:45:41 user nova-compute[70914]:       <entry name="uuid">cbf6d0ec-b91d-4db5-b863-156754c746bc</entry>
Jul 27 13:45:41 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:45:41 user nova-compute[70914]:     </system>
Jul 27 13:45:41 user nova-compute[70914]:   </sysinfo>
Jul 27 13:45:41 user nova-compute[70914]:   <os>
Jul 27 13:45:41 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:45:41 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:45:41 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:45:41 user nova-compute[70914]:   </os>
Jul 27 13:45:41 user nova-compute[70914]:   <features>
Jul 27 13:45:41 user nova-compute[70914]:     <acpi/>
Jul 27 13:45:41 user nova-compute[70914]:     <apic/>
Jul 27 13:45:41 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:45:41 user nova-compute[70914]:   </features>
Jul 27 13:45:41 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:45:41 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:45:41 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:45:41 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:45:41 user nova-compute[70914]:   </clock>
Jul 27 13:45:41 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:45:41 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:45:41 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:45:41 user nova-compute[70914]:   </cpu>
Jul 27 13:45:41 user nova-compute[70914]:   <devices>
Jul 27 13:45:41 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:45:41 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:45:41 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk"/>
Jul 27 13:45:41 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:45:41 user nova-compute[70914]:     </disk>
Jul 27 13:45:41 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:45:41 user nova-compute[70914]:       <mac address="fa:16:3e:36:7d:4f"/>
Jul 27 13:45:41 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:45:41 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:45:41 user nova-compute[70914]:       <target dev="tapc1ae2dfc-c7"/>
Jul 27 13:45:41 user nova-compute[70914]:     </interface>
Jul 27 13:45:41 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:45:41 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/console.log" append="off"/>
Jul 27 13:45:41 user nova-compute[70914]:     </serial>
Jul 27 13:45:41 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:45:41 user nova-compute[70914]:     <video>
Jul 27 13:45:41 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:45:41 user nova-compute[70914]:     </video>
Jul 27 13:45:41 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:45:41 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:45:41 user nova-compute[70914]:     </rng>
Jul 27 13:45:41 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:45:41 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:45:41 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:45:41 user nova-compute[70914]:     </memballoon>
Jul 27 13:45:41 user nova-compute[70914]:   </devices>
Jul 27 13:45:41 user nova-compute[70914]: </domain>
Jul 27 13:45:41 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:45:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-644580012',display_name='tempest-VolumesSnapshotTestJSON-instance-644580012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-644580012',id=28,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNo5qJ+pKdNd63nJVYeexr/7s1uP5MLIjHcEEWV2oJMtLv1STTdDkX6Gk+GokxTCJMgMxGOdeMvGqfxPHBZ3/6TT85zUVqSVp95uGcMOGbOJ4QATR0nyyvrqXd2EXIE5Q==',key_name='tempest-keypair-1404813722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82c2842f73314df7b38893d27acf46e0',ramdisk_id='',reservation_id='r-0kdmaqnf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-277407372',owner_user_name='tempest-VolumesSnapshotTestJSON-277407372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:45:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0d5277a420b42bfb40dfc0196fea575',uuid=cbf6d0ec-b91d-4db5-b863-156754c746bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converting VIF {"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:7d:4f,bridge_name='br-int',has_traffic_filtering=True,id=c1ae2dfc-c734-4be9-bdd3-568940fbeb0a,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ae2dfc-c7') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG os_vif [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:7d:4f,bridge_name='br-int',has_traffic_filtering=True,id=c1ae2dfc-c734-4be9-bdd3-568940fbeb0a,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ae2dfc-c7') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1ae2dfc-c7, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1ae2dfc-c7, col_values=(('external_ids', {'iface-id': 'c1ae2dfc-c734-4be9-bdd3-568940fbeb0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:7d:4f', 'vm-uuid': 'cbf6d0ec-b91d-4db5-b863-156754c746bc'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:41 user nova-compute[70914]: INFO os_vif [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:7d:4f,bridge_name='br-int',has_traffic_filtering=True,id=c1ae2dfc-c734-4be9-bdd3-568940fbeb0a,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ae2dfc-c7')
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] No VIF found with MAC fa:16:3e:36:7d:4f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-f833b88a-bb38-4e86-a719-596995a9837c req-99492ad5-c515-4a70-b147-22df5c3b6697 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Updated VIF entry in instance network info cache for port c1ae2dfc-c734-4be9-bdd3-568940fbeb0a. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-f833b88a-bb38-4e86-a719-596995a9837c req-99492ad5-c515-4a70-b147-22df5c3b6697 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Updating instance_info_cache with network_info: [{"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:45:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f833b88a-bb38-4e86-a719-596995a9837c req-99492ad5-c515-4a70-b147-22df5c3b6697 service nova] Releasing lock "refresh_cache-cbf6d0ec-b91d-4db5-b863-156754c746bc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:45:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG nova.compute.manager [req-f3ca7314-adf9-4e11-a589-67d9da2596f0 req-21cb04db-9eb9-425d-a95d-6d6a926f4648 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f3ca7314-adf9-4e11-a589-67d9da2596f0 req-21cb04db-9eb9-425d-a95d-6d6a926f4648 service nova] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f3ca7314-adf9-4e11-a589-67d9da2596f0 req-21cb04db-9eb9-425d-a95d-6d6a926f4648 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f3ca7314-adf9-4e11-a589-67d9da2596f0 req-21cb04db-9eb9-425d-a95d-6d6a926f4648 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG nova.compute.manager [req-f3ca7314-adf9-4e11-a589-67d9da2596f0 req-21cb04db-9eb9-425d-a95d-6d6a926f4648 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] No waiting events found dispatching network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:45:43 user nova-compute[70914]: WARNING nova.compute.manager [req-f3ca7314-adf9-4e11-a589-67d9da2596f0 req-21cb04db-9eb9-425d-a95d-6d6a926f4648 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received unexpected event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a for instance with vm_state building and task_state spawning.
Jul 27 13:45:43 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465528.312085, 8897428a-7e38-49ed-9013-df0d2160196e => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:45:43 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] VM Stopped (Lifecycle Event)
Jul 27 13:45:43 user nova-compute[70914]: DEBUG nova.compute.manager [None req-370210b0-b4fb-4aeb-afec-44b1b5096068 None None] [instance: 8897428a-7e38-49ed-9013-df0d2160196e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465545.0016463, cbf6d0ec-b91d-4db5-b863-156754c746bc => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:45:45 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] VM Resumed (Lifecycle Event)
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:45:45 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Instance spawned successfully.
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.compute.manager [req-9d3889dc-8d19-4e72-af4f-2ad43dd26a82 req-840ce40a-1779-4257-ae5a-e7bd44d00549 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9d3889dc-8d19-4e72-af4f-2ad43dd26a82 req-840ce40a-1779-4257-ae5a-e7bd44d00549 service nova] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9d3889dc-8d19-4e72-af4f-2ad43dd26a82 req-840ce40a-1779-4257-ae5a-e7bd44d00549 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9d3889dc-8d19-4e72-af4f-2ad43dd26a82 req-840ce40a-1779-4257-ae5a-e7bd44d00549 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.compute.manager [req-9d3889dc-8d19-4e72-af4f-2ad43dd26a82 req-840ce40a-1779-4257-ae5a-e7bd44d00549 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] No waiting events found dispatching network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:45:45 user nova-compute[70914]: WARNING nova.compute.manager [req-9d3889dc-8d19-4e72-af4f-2ad43dd26a82 req-840ce40a-1779-4257-ae5a-e7bd44d00549 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received unexpected event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a for instance with vm_state building and task_state spawning.
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:45 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465545.0029645, cbf6d0ec-b91d-4db5-b863-156754c746bc => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:45:45 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] VM Started (Lifecycle Event)
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:45 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:45:45 user nova-compute[70914]: INFO nova.compute.manager [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Took 5.65 seconds to spawn the instance on the hypervisor.
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:45 user nova-compute[70914]: INFO nova.compute.manager [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Took 6.50 seconds to build instance.
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7539298a-7e44-4d80-88ca-805191a1c1d5 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.619s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:45:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:46 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:45:46 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7577MB free_disk=25.330646514892578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 30050776-6e41-487a-9ad2-342b18a7b72f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0371b280-fc39-4cbd-b496-ba78fea4e856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cbf6d0ec-b91d-4db5-b863-156754c746bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:45:46 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.083s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:45:47 user nova-compute[70914]: INFO nova.compute.claims [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Claim successful on node user
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:45:47 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.policy [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52e4c423609f4481b1634fbaca3e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca794885b0f49cf84038cd7c3edf9ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:45:47 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Creating image(s)
Jul 27 13:45:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "/opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "/opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.196s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk 1073741824" returned: 0 in 0.067s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.174s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Successfully created port: 52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Cannot resize image /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lazy-loading 'migration_context' on Instance uuid d1f1d62d-885b-47b9-8d4d-972da97cba2f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Ensure instance console log exists: /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Successfully updated port: 52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "refresh_cache-d1f1d62d-885b-47b9-8d4d-972da97cba2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquired lock "refresh_cache-d1f1d62d-885b-47b9-8d4d-972da97cba2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-8e676346-bb34-4ddb-8bdd-d49b81c7ab19 req-a4275e67-9dae-4943-872e-ea56a335f7ca service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Received event network-changed-52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-8e676346-bb34-4ddb-8bdd-d49b81c7ab19 req-a4275e67-9dae-4943-872e-ea56a335f7ca service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Refreshing instance network info cache due to event network-changed-52e6d29e-16ee-4279-889c-cbfbb57004bf. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e676346-bb34-4ddb-8bdd-d49b81c7ab19 req-a4275e67-9dae-4943-872e-ea56a335f7ca service nova] Acquiring lock "refresh_cache-d1f1d62d-885b-47b9-8d4d-972da97cba2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Updating instance_info_cache with network_info: [{"id": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "address": "fa:16:3e:88:49:25", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e6d29e-16", "ovs_interfaceid": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Releasing lock "refresh_cache-d1f1d62d-885b-47b9-8d4d-972da97cba2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Instance network_info: |[{"id": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "address": "fa:16:3e:88:49:25", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e6d29e-16", "ovs_interfaceid": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e676346-bb34-4ddb-8bdd-d49b81c7ab19 req-a4275e67-9dae-4943-872e-ea56a335f7ca service nova] Acquired lock "refresh_cache-d1f1d62d-885b-47b9-8d4d-972da97cba2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.network.neutron [req-8e676346-bb34-4ddb-8bdd-d49b81c7ab19 req-a4275e67-9dae-4943-872e-ea56a335f7ca service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Refreshing network info cache for port 52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Start _get_guest_xml network_info=[{"id": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "address": "fa:16:3e:88:49:25", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e6d29e-16", "ovs_interfaceid": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:45:49 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:45:49 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:45:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-826268357',display_name='tempest-VolumesActionsTest-instance-826268357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-826268357',id=29,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bca794885b0f49cf84038cd7c3edf9ee',ramdisk_id='',reservation_id='r-xfcybgxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1110307362',owner_user_name='tempest-VolumesActionsTest-1110307362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:45:48Z,user_data=None,user_id='52e4c423609f4481b1634fbaca3e7ddb',uuid=d1f1d62d-885b-47b9-8d4d-972da97cba2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "address": "fa:16:3e:88:49:25", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e6d29e-16", "ovs_interfaceid": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converting VIF {"id": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "address": "fa:16:3e:88:49:25", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e6d29e-16", "ovs_interfaceid": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:49:25,bridge_name='br-int',has_traffic_filtering=True,id=52e6d29e-16ee-4279-889c-cbfbb57004bf,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e6d29e-16') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lazy-loading 'pci_devices' on Instance uuid d1f1d62d-885b-47b9-8d4d-972da97cba2f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:45:50 user nova-compute[70914]:   <uuid>d1f1d62d-885b-47b9-8d4d-972da97cba2f</uuid>
Jul 27 13:45:50 user nova-compute[70914]:   <name>instance-0000001d</name>
Jul 27 13:45:50 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:45:50 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:45:50 user nova-compute[70914]:   <metadata>
Jul 27 13:45:50 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:45:50 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:45:50 user nova-compute[70914]:       <nova:name>tempest-VolumesActionsTest-instance-826268357</nova:name>
Jul 27 13:45:50 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:45:49</nova:creationTime>
Jul 27 13:45:50 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:45:50 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:45:50 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:45:50 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:45:50 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:45:50 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:45:50 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:45:50 user nova-compute[70914]:       <nova:owner>
Jul 27 13:45:50 user nova-compute[70914]:         <nova:user uuid="52e4c423609f4481b1634fbaca3e7ddb">tempest-VolumesActionsTest-1110307362-project-member</nova:user>
Jul 27 13:45:50 user nova-compute[70914]:         <nova:project uuid="bca794885b0f49cf84038cd7c3edf9ee">tempest-VolumesActionsTest-1110307362</nova:project>
Jul 27 13:45:50 user nova-compute[70914]:       </nova:owner>
Jul 27 13:45:50 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:45:50 user nova-compute[70914]:       <nova:ports>
Jul 27 13:45:50 user nova-compute[70914]:         <nova:port uuid="52e6d29e-16ee-4279-889c-cbfbb57004bf">
Jul 27 13:45:50 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 13:45:50 user nova-compute[70914]:         </nova:port>
Jul 27 13:45:50 user nova-compute[70914]:       </nova:ports>
Jul 27 13:45:50 user nova-compute[70914]:     </nova:instance>
Jul 27 13:45:50 user nova-compute[70914]:   </metadata>
Jul 27 13:45:50 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:45:50 user nova-compute[70914]:     <system>
Jul 27 13:45:50 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:45:50 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:45:50 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:45:50 user nova-compute[70914]:       <entry name="serial">d1f1d62d-885b-47b9-8d4d-972da97cba2f</entry>
Jul 27 13:45:50 user nova-compute[70914]:       <entry name="uuid">d1f1d62d-885b-47b9-8d4d-972da97cba2f</entry>
Jul 27 13:45:50 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:45:50 user nova-compute[70914]:     </system>
Jul 27 13:45:50 user nova-compute[70914]:   </sysinfo>
Jul 27 13:45:50 user nova-compute[70914]:   <os>
Jul 27 13:45:50 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:45:50 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:45:50 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:45:50 user nova-compute[70914]:   </os>
Jul 27 13:45:50 user nova-compute[70914]:   <features>
Jul 27 13:45:50 user nova-compute[70914]:     <acpi/>
Jul 27 13:45:50 user nova-compute[70914]:     <apic/>
Jul 27 13:45:50 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:45:50 user nova-compute[70914]:   </features>
Jul 27 13:45:50 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:45:50 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:45:50 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:45:50 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:45:50 user nova-compute[70914]:   </clock>
Jul 27 13:45:50 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:45:50 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:45:50 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:45:50 user nova-compute[70914]:   </cpu>
Jul 27 13:45:50 user nova-compute[70914]:   <devices>
Jul 27 13:45:50 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:45:50 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:45:50 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk"/>
Jul 27 13:45:50 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:45:50 user nova-compute[70914]:     </disk>
Jul 27 13:45:50 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:45:50 user nova-compute[70914]:       <mac address="fa:16:3e:88:49:25"/>
Jul 27 13:45:50 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:45:50 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:45:50 user nova-compute[70914]:       <target dev="tap52e6d29e-16"/>
Jul 27 13:45:50 user nova-compute[70914]:     </interface>
Jul 27 13:45:50 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:45:50 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/console.log" append="off"/>
Jul 27 13:45:50 user nova-compute[70914]:     </serial>
Jul 27 13:45:50 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:45:50 user nova-compute[70914]:     <video>
Jul 27 13:45:50 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:45:50 user nova-compute[70914]:     </video>
Jul 27 13:45:50 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:45:50 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:45:50 user nova-compute[70914]:     </rng>
Jul 27 13:45:50 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:45:50 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:45:50 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:45:50 user nova-compute[70914]:     </memballoon>
Jul 27 13:45:50 user nova-compute[70914]:   </devices>
Jul 27 13:45:50 user nova-compute[70914]: </domain>
Jul 27 13:45:50 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-826268357',display_name='tempest-VolumesActionsTest-instance-826268357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-826268357',id=29,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bca794885b0f49cf84038cd7c3edf9ee',ramdisk_id='',reservation_id='r-xfcybgxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1110307362',owner_user_name='tempest-VolumesActionsTest-1110307362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:45:48Z,user_data=None,user_id='52e4c423609f4481b1634fbaca3e7ddb',uuid=d1f1d62d-885b-47b9-8d4d-972da97cba2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "address": "fa:16:3e:88:49:25", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e6d29e-16", "ovs_interfaceid": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converting VIF {"id": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "address": "fa:16:3e:88:49:25", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e6d29e-16", "ovs_interfaceid": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:49:25,bridge_name='br-int',has_traffic_filtering=True,id=52e6d29e-16ee-4279-889c-cbfbb57004bf,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e6d29e-16') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG os_vif [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:49:25,bridge_name='br-int',has_traffic_filtering=True,id=52e6d29e-16ee-4279-889c-cbfbb57004bf,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e6d29e-16') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52e6d29e-16, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52e6d29e-16, col_values=(('external_ids', {'iface-id': '52e6d29e-16ee-4279-889c-cbfbb57004bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:49:25', 'vm-uuid': 'd1f1d62d-885b-47b9-8d4d-972da97cba2f'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:50 user nova-compute[70914]: INFO os_vif [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:49:25,bridge_name='br-int',has_traffic_filtering=True,id=52e6d29e-16ee-4279-889c-cbfbb57004bf,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e6d29e-16')
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] No VIF found with MAC fa:16:3e:88:49:25, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.network.neutron [req-8e676346-bb34-4ddb-8bdd-d49b81c7ab19 req-a4275e67-9dae-4943-872e-ea56a335f7ca service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Updated VIF entry in instance network info cache for port 52e6d29e-16ee-4279-889c-cbfbb57004bf. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.network.neutron [req-8e676346-bb34-4ddb-8bdd-d49b81c7ab19 req-a4275e67-9dae-4943-872e-ea56a335f7ca service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Updating instance_info_cache with network_info: [{"id": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "address": "fa:16:3e:88:49:25", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e6d29e-16", "ovs_interfaceid": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e676346-bb34-4ddb-8bdd-d49b81c7ab19 req-a4275e67-9dae-4943-872e-ea56a335f7ca service nova] Releasing lock "refresh_cache-d1f1d62d-885b-47b9-8d4d-972da97cba2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Skipping network cache update for instance because it is Building. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:45:50 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updating instance_info_cache with network_info: [{"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-1b676522-c547-497a-9b3b-8436f85c7f40" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-b97a5dc6-0657-4d1c-a670-af7787616126 req-a7110db1-802a-4160-903a-bb835730a474 service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Received event network-vif-plugged-52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b97a5dc6-0657-4d1c-a670-af7787616126 req-a7110db1-802a-4160-903a-bb835730a474 service nova] Acquiring lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b97a5dc6-0657-4d1c-a670-af7787616126 req-a7110db1-802a-4160-903a-bb835730a474 service nova] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b97a5dc6-0657-4d1c-a670-af7787616126 req-a7110db1-802a-4160-903a-bb835730a474 service nova] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-b97a5dc6-0657-4d1c-a670-af7787616126 req-a7110db1-802a-4160-903a-bb835730a474 service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] No waiting events found dispatching network-vif-plugged-52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:45:51 user nova-compute[70914]: WARNING nova.compute.manager [req-b97a5dc6-0657-4d1c-a670-af7787616126 req-a7110db1-802a-4160-903a-bb835730a474 service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Received unexpected event network-vif-plugged-52e6d29e-16ee-4279-889c-cbfbb57004bf for instance with vm_state building and task_state spawning.
Jul 27 13:45:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465553.618327, d1f1d62d-885b-47b9-8d4d-972da97cba2f => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:45:53 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] VM Resumed (Lifecycle Event)
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:45:53 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Instance spawned successfully.
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:45:53 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465553.6287262, d1f1d62d-885b-47b9-8d4d-972da97cba2f => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:45:53 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] VM Started (Lifecycle Event)
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-509b4053-eb47-4fcc-9b59-972f60c14df9 req-4124abc3-8eb4-4f58-b525-e85701b7b7d0 service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Received event network-vif-plugged-52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-509b4053-eb47-4fcc-9b59-972f60c14df9 req-4124abc3-8eb4-4f58-b525-e85701b7b7d0 service nova] Acquiring lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-509b4053-eb47-4fcc-9b59-972f60c14df9 req-4124abc3-8eb4-4f58-b525-e85701b7b7d0 service nova] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-509b4053-eb47-4fcc-9b59-972f60c14df9 req-4124abc3-8eb4-4f58-b525-e85701b7b7d0 service nova] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-509b4053-eb47-4fcc-9b59-972f60c14df9 req-4124abc3-8eb4-4f58-b525-e85701b7b7d0 service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] No waiting events found dispatching network-vif-plugged-52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:45:53 user nova-compute[70914]: WARNING nova.compute.manager [req-509b4053-eb47-4fcc-9b59-972f60c14df9 req-4124abc3-8eb4-4f58-b525-e85701b7b7d0 service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Received unexpected event network-vif-plugged-52e6d29e-16ee-4279-889c-cbfbb57004bf for instance with vm_state building and task_state spawning.
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:45:53 user nova-compute[70914]: INFO nova.compute.manager [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Took 5.83 seconds to spawn the instance on the hypervisor.
Jul 27 13:45:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:45:53 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:45:53 user nova-compute[70914]: INFO nova.compute.manager [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Took 6.64 seconds to build instance.
Jul 27 13:45:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b4376ff-c097-4415-bc6b-130520fd743b tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.754s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:45:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:45:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:46:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:46:01 user nova-compute[70914]: INFO nova.compute.claims [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Claim successful on node user
Jul 27 13:46:01 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:46:01 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:46:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:46:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:46:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:46:02 user nova-compute[70914]: INFO nova.virt.block_device [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Booting with volume aafdbf40-2399-4ec2-8c9d-4504787a18f3 at /dev/vda
Jul 27 13:46:02 user nova-compute[70914]: DEBUG nova.policy [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '252ad07dbf034a09b3be3c05dba67b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da684ade5ad4a328eb543f6d6da0ad9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG os_brick.utils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c606e52c-4935-409d-9d0f-84ee9e96d5d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d49b24-197f-4044-9d3e-9e2dce2c5332]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ae17ce-b9f0-4238-a27f-f3c97bc50e00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[41255097-be8e-4dd1-a05d-e7fbb2f0e343]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:46:02 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:46:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea2d29a-9f38-43ca-a650-4499adb5c7f4]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG os_brick.utils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:46:02 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updating existing volume attachment record: d37e7e6a-4efc-4ee7-87f3-16fd1ee6e98b {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:46:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Successfully created port: 7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG nova.network.neutron [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Successfully updated port: 7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquired lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG nova.network.neutron [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-55ebafc0-43fb-4030-8a7c-f0678693200c req-4d9a7d25-9962-4e80-87fa-e77643287fe6 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-changed-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-55ebafc0-43fb-4030-8a7c-f0678693200c req-4d9a7d25-9962-4e80-87fa-e77643287fe6 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Refreshing instance network info cache due to event network-changed-7987dffb-bb71-444e-b737-5c05b30e972b. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-55ebafc0-43fb-4030-8a7c-f0678693200c req-4d9a7d25-9962-4e80-87fa-e77643287fe6 service nova] Acquiring lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG nova.network.neutron [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG nova.network.neutron [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updating instance_info_cache with network_info: [{"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Releasing lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG nova.compute.manager [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Instance network_info: |[{"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-55ebafc0-43fb-4030-8a7c-f0678693200c req-4d9a7d25-9962-4e80-87fa-e77643287fe6 service nova] Acquired lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:46:04 user nova-compute[70914]: DEBUG nova.network.neutron [req-55ebafc0-43fb-4030-8a7c-f0678693200c req-4d9a7d25-9962-4e80-87fa-e77643287fe6 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Refreshing network info cache for port 7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:46:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:05 user nova-compute[70914]: DEBUG nova.network.neutron [req-55ebafc0-43fb-4030-8a7c-f0678693200c req-4d9a7d25-9962-4e80-87fa-e77643287fe6 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updated VIF entry in instance network info cache for port 7987dffb-bb71-444e-b737-5c05b30e972b. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:46:05 user nova-compute[70914]: DEBUG nova.network.neutron [req-55ebafc0-43fb-4030-8a7c-f0678693200c req-4d9a7d25-9962-4e80-87fa-e77643287fe6 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updating instance_info_cache with network_info: [{"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:46:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-55ebafc0-43fb-4030-8a7c-f0678693200c req-4d9a7d25-9962-4e80-87fa-e77643287fe6 service nova] Releasing lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:46:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Creating image(s)
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Ensure instance console log exists: /opt/stack/data/nova/instances/3b8cffe7-b0ad-487b-8229-54469afefdd2/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Start _get_guest_xml network_info=[{"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'd37e7e6a-4efc-4ee7-87f3-16fd1ee6e98b', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvDGkwep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b8cffe7-b0ad-487b-8229-54469afefdd2', 'attached_at': '', 'detached_at': '', 'volume_id': 'aafdbf40-2399-4ec2-8c9d-4504787a18f3', 'serial': 'aafdbf40-2399-4ec2-8c9d-4504787a18f3'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:46:09 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:46:09 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:46:09 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvDGkwep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:46:10 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:46:10 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:46:10 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9b6709-863b-4623-9c22-9219039f251c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:46:10 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98c8555-d330-4eb2-a12b-abbe4b72ca5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3] added
Jul 27 13:46:10 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1974289-96c4-4fea-a3de-e81251483dd1]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b35396d-7894-4145-899e-db1675a00be4]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvDGkwep {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvDGkwep" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd2a78-a0be-481d-8941-cfdfeb931431]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvDGkwep'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f06ecc-110c-4173-82b6-e8d6f03ab93d]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aee303-e55e-429a-98b6-9262cf7b7a40]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:46:10 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:10 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:10 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:46:10 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:10 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:10 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a5fda2-8c0e-4396-9fa7-17e84e245b79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260]
Jul 27 13:46:10 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260] successful.
Jul 27 13:46:10 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8946f407-3240-412a-823b-1c15a88cb948]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5f8147-5fee-4004-a09d-a9794318b573]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:46:10 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:10 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:10 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:46:10 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:46:10 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:10 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:10 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:46:10 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8837e614-e97d-46f1-adcf-d04b8dbe3dfa]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:46:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvDGkwep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23963613533353932', 'path': '/dev/sde'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963613533353932', 'path': '/dev/sde'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1759781246',display_name='tempest-ServerActionsTestOtherA-server-1759781246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1759781246',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-o61s0k8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=3b8cffe7-b0ad-487b-8229-54469afefdd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.objects.instance [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b8cffe7-b0ad-487b-8229-54469afefdd2 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:46:11 user nova-compute[70914]:   <uuid>3b8cffe7-b0ad-487b-8229-54469afefdd2</uuid>
Jul 27 13:46:11 user nova-compute[70914]:   <name>instance-0000001e</name>
Jul 27 13:46:11 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:46:11 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:46:11 user nova-compute[70914]:   <metadata>
Jul 27 13:46:11 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:46:11 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:46:11 user nova-compute[70914]:       <nova:name>tempest-ServerActionsTestOtherA-server-1759781246</nova:name>
Jul 27 13:46:11 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:46:09</nova:creationTime>
Jul 27 13:46:11 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:46:11 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:46:11 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:46:11 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:46:11 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:46:11 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:46:11 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:46:11 user nova-compute[70914]:       <nova:owner>
Jul 27 13:46:11 user nova-compute[70914]:         <nova:user uuid="252ad07dbf034a09b3be3c05dba67b3f">tempest-ServerActionsTestOtherA-1561010505-project-member</nova:user>
Jul 27 13:46:11 user nova-compute[70914]:         <nova:project uuid="5da684ade5ad4a328eb543f6d6da0ad9">tempest-ServerActionsTestOtherA-1561010505</nova:project>
Jul 27 13:46:11 user nova-compute[70914]:       </nova:owner>
Jul 27 13:46:11 user nova-compute[70914]:       <nova:ports>
Jul 27 13:46:11 user nova-compute[70914]:         <nova:port uuid="7987dffb-bb71-444e-b737-5c05b30e972b">
Jul 27 13:46:11 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 13:46:11 user nova-compute[70914]:         </nova:port>
Jul 27 13:46:11 user nova-compute[70914]:       </nova:ports>
Jul 27 13:46:11 user nova-compute[70914]:     </nova:instance>
Jul 27 13:46:11 user nova-compute[70914]:   </metadata>
Jul 27 13:46:11 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:46:11 user nova-compute[70914]:     <system>
Jul 27 13:46:11 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:46:11 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:46:11 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:46:11 user nova-compute[70914]:       <entry name="serial">3b8cffe7-b0ad-487b-8229-54469afefdd2</entry>
Jul 27 13:46:11 user nova-compute[70914]:       <entry name="uuid">3b8cffe7-b0ad-487b-8229-54469afefdd2</entry>
Jul 27 13:46:11 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:46:11 user nova-compute[70914]:     </system>
Jul 27 13:46:11 user nova-compute[70914]:   </sysinfo>
Jul 27 13:46:11 user nova-compute[70914]:   <os>
Jul 27 13:46:11 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:46:11 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:46:11 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:46:11 user nova-compute[70914]:   </os>
Jul 27 13:46:11 user nova-compute[70914]:   <features>
Jul 27 13:46:11 user nova-compute[70914]:     <acpi/>
Jul 27 13:46:11 user nova-compute[70914]:     <apic/>
Jul 27 13:46:11 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:46:11 user nova-compute[70914]:   </features>
Jul 27 13:46:11 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:46:11 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:46:11 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:46:11 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:46:11 user nova-compute[70914]:   </clock>
Jul 27 13:46:11 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:46:11 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:46:11 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:46:11 user nova-compute[70914]:   </cpu>
Jul 27 13:46:11 user nova-compute[70914]:   <devices>
Jul 27 13:46:11 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:46:11 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:46:11 user nova-compute[70914]:       <source dev="/dev/sde"/>
Jul 27 13:46:11 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:46:11 user nova-compute[70914]:       <serial>aafdbf40-2399-4ec2-8c9d-4504787a18f3</serial>
Jul 27 13:46:11 user nova-compute[70914]:     </disk>
Jul 27 13:46:11 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:46:11 user nova-compute[70914]:       <mac address="fa:16:3e:f2:ce:a9"/>
Jul 27 13:46:11 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:46:11 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:46:11 user nova-compute[70914]:       <target dev="tap7987dffb-bb"/>
Jul 27 13:46:11 user nova-compute[70914]:     </interface>
Jul 27 13:46:11 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:46:11 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/3b8cffe7-b0ad-487b-8229-54469afefdd2/console.log" append="off"/>
Jul 27 13:46:11 user nova-compute[70914]:     </serial>
Jul 27 13:46:11 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:46:11 user nova-compute[70914]:     <video>
Jul 27 13:46:11 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:46:11 user nova-compute[70914]:     </video>
Jul 27 13:46:11 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:46:11 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:46:11 user nova-compute[70914]:     </rng>
Jul 27 13:46:11 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:46:11 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:46:11 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:46:11 user nova-compute[70914]:     </memballoon>
Jul 27 13:46:11 user nova-compute[70914]:   </devices>
Jul 27 13:46:11 user nova-compute[70914]: </domain>
Jul 27 13:46:11 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1759781246',display_name='tempest-ServerActionsTestOtherA-server-1759781246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1759781246',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-o61s0k8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=3b8cffe7-b0ad-487b-8229-54469afefdd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG os_vif [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7987dffb-bb, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7987dffb-bb, col_values=(('external_ids', {'iface-id': '7987dffb-bb71-444e-b737-5c05b30e972b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:ce:a9', 'vm-uuid': '3b8cffe7-b0ad-487b-8229-54469afefdd2'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:11 user nova-compute[70914]: INFO os_vif [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb')
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:46:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No VIF found with MAC fa:16:3e:f2:ce:a9, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:46:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-80bb6f25-e75d-42e4-8341-ea40f2bbbbc4 req-0f357bb9-c54d-454c-b2fe-1b52b9abf803 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-80bb6f25-e75d-42e4-8341-ea40f2bbbbc4 req-0f357bb9-c54d-454c-b2fe-1b52b9abf803 service nova] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-80bb6f25-e75d-42e4-8341-ea40f2bbbbc4 req-0f357bb9-c54d-454c-b2fe-1b52b9abf803 service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-80bb6f25-e75d-42e4-8341-ea40f2bbbbc4 req-0f357bb9-c54d-454c-b2fe-1b52b9abf803 service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-80bb6f25-e75d-42e4-8341-ea40f2bbbbc4 req-0f357bb9-c54d-454c-b2fe-1b52b9abf803 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] No waiting events found dispatching network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:46:13 user nova-compute[70914]: WARNING nova.compute.manager [req-80bb6f25-e75d-42e4-8341-ea40f2bbbbc4 req-0f357bb9-c54d-454c-b2fe-1b52b9abf803 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received unexpected event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b for instance with vm_state building and task_state spawning.
Jul 27 13:46:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465574.895803, 3b8cffe7-b0ad-487b-8229-54469afefdd2 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:46:14 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] VM Resumed (Lifecycle Event)
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:46:14 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Instance spawned successfully.
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:46:14 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465574.89696, 3b8cffe7-b0ad-487b-8229-54469afefdd2 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:46:14 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] VM Started (Lifecycle Event)
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:46:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:46:15 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:46:15 user nova-compute[70914]: INFO nova.compute.manager [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Took 5.06 seconds to spawn the instance on the hypervisor.
Jul 27 13:46:15 user nova-compute[70914]: DEBUG nova.compute.manager [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:46:15 user nova-compute[70914]: INFO nova.compute.manager [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Took 13.61 seconds to build instance.
Jul 27 13:46:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-572cdbad-5109-4692-9781-fa3bf42ae433 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.748s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:15 user nova-compute[70914]: DEBUG nova.compute.manager [req-1724b2ef-8a85-43d5-b513-3753dd7604bc req-51ee5715-bc48-4c16-8cbd-13e45d5e9748 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1724b2ef-8a85-43d5-b513-3753dd7604bc req-51ee5715-bc48-4c16-8cbd-13e45d5e9748 service nova] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1724b2ef-8a85-43d5-b513-3753dd7604bc req-51ee5715-bc48-4c16-8cbd-13e45d5e9748 service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1724b2ef-8a85-43d5-b513-3753dd7604bc req-51ee5715-bc48-4c16-8cbd-13e45d5e9748 service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:15 user nova-compute[70914]: DEBUG nova.compute.manager [req-1724b2ef-8a85-43d5-b513-3753dd7604bc req-51ee5715-bc48-4c16-8cbd-13e45d5e9748 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] No waiting events found dispatching network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:46:15 user nova-compute[70914]: WARNING nova.compute.manager [req-1724b2ef-8a85-43d5-b513-3753dd7604bc req-51ee5715-bc48-4c16-8cbd-13e45d5e9748 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received unexpected event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b for instance with vm_state active and task_state None.
Jul 27 13:46:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:18 user nova-compute[70914]: INFO nova.compute.manager [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Unshelving
Jul 27 13:46:18 user nova-compute[70914]: INFO nova.virt.block_device [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Booting with volume 6f2203aa-baa2-4a45-8081-82734d7bdd97 at /dev/vdc
Jul 27 13:46:18 user nova-compute[70914]: DEBUG os_brick.utils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bcdfeb-de5e-4281-b693-10723240d07d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba35cfe8-21ef-43af-a19d-d2b7aacaba3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f663f32-6919-4614-9b52-c56a27f9f3cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a166e04-bf50-4927-b96e-2369dbb0c51b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:46:18 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:46:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5718668a-20fb-4d7a-97a0-6cd1ab6bb2b2]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:46:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:46:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:46:19 user nova-compute[70914]: DEBUG os_brick.utils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:46:19 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updating existing volume attachment record: 99809b06-b8fd-429c-80de-03f0cfdee4ec {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:46:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'pci_requests' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:46:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:46:26 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:46:26 user nova-compute[70914]: INFO nova.compute.claims [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Claim successful on node user
Jul 27 13:46:27 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:46:27 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:46:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:27 user nova-compute[70914]: INFO nova.network.neutron [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updating port ef1f245c-0a46-4cd8-8851-c93741559d97 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 13:46:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:46:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquired lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:46:28 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:46:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-aac0ee82-1c2a-4ca6-909a-f3c80ebc31d8 req-1fb9c8bc-d610-4c14-8401-e3c05d4e9354 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-changed-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-aac0ee82-1c2a-4ca6-909a-f3c80ebc31d8 req-1fb9c8bc-d610-4c14-8401-e3c05d4e9354 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Refreshing instance network info cache due to event network-changed-ef1f245c-0a46-4cd8-8851-c93741559d97. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:46:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aac0ee82-1c2a-4ca6-909a-f3c80ebc31d8 req-1fb9c8bc-d610-4c14-8401-e3c05d4e9354 service nova] Acquiring lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:46:29 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updating instance_info_cache with network_info: [{"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:46:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Releasing lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:46:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:46:29 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Creating image(s)
Jul 27 13:46:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "/opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "/opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:29 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:46:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aac0ee82-1c2a-4ca6-909a-f3c80ebc31d8 req-1fb9c8bc-d610-4c14-8401-e3c05d4e9354 service nova] Acquired lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:46:29 user nova-compute[70914]: DEBUG nova.network.neutron [req-aac0ee82-1c2a-4ca6-909a-f3c80ebc31d8 req-1fb9c8bc-d610-4c14-8401-e3c05d4e9354 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Refreshing network info cache for port ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:46:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "8b2d7b8196b92a30ecba4c735d2ffcd878300921" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8b2d7b8196b92a30ecba4c735d2ffcd878300921" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921.part --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921.part --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG nova.virt.images [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] 191467a6-4de0-4308-a62e-cc5ed7bbd05e was qcow2, converting to raw {{(pid=70914) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921.part /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921.converted {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921.part /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921.converted" returned: 0 in 0.232s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921.converted --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG nova.network.neutron [req-aac0ee82-1c2a-4ca6-909a-f3c80ebc31d8 req-1fb9c8bc-d610-4c14-8401-e3c05d4e9354 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updated VIF entry in instance network info cache for port ef1f245c-0a46-4cd8-8851-c93741559d97. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG nova.network.neutron [req-aac0ee82-1c2a-4ca6-909a-f3c80ebc31d8 req-1fb9c8bc-d610-4c14-8401-e3c05d4e9354 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updating instance_info_cache with network_info: [{"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aac0ee82-1c2a-4ca6-909a-f3c80ebc31d8 req-1fb9c8bc-d610-4c14-8401-e3c05d4e9354 service nova] Releasing lock "refresh_cache-4e856bc3-ce45-4307-af2b-33c82ed1eccc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8b2d7b8196b92a30ecba4c735d2ffcd878300921" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.373s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921 --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "8b2d7b8196b92a30ecba4c735d2ffcd878300921" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8b2d7b8196b92a30ecba4c735d2ffcd878300921" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921 --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921,backing_fmt=raw /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921,backing_fmt=raw /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk 1073741824" returned: 0 in 0.050s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8b2d7b8196b92a30ecba4c735d2ffcd878300921" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921 --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921 --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'migration_context' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:46:31 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Rebasing disk image.
Jul 27 13:46:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d -F raw /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d -F raw /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk" returned: 0 in 2.121s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Ensure instance console log exists: /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Start _get_guest_xml network_info=[{"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='01d158f29781e92b8f5661cdb5c9cc17',container_format='bare',created_at=2023-07-27T13:44:26Z,direct_url=<?>,disk_format='qcow2',id=191467a6-4de0-4308-a62e-cc5ed7bbd05e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1002806692-shelved',owner='30c132beeb2d43b1b568da4492f2ffc9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T13:44:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '99809b06-b8fd-429c-80de-03f0cfdee4ec', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZRaUkpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4e856bc3-ce45-4307-af2b-33c82ed1eccc', 'attached_at': '', 'detached_at': '', 'volume_id': '6f2203aa-baa2-4a45-8081-82734d7bdd97', 'serial': '6f2203aa-baa2-4a45-8081-82734d7bdd97'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:46:33 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:46:33 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='01d158f29781e92b8f5661cdb5c9cc17',container_format='bare',created_at=2023-07-27T13:44:26Z,direct_url=<?>,disk_format='qcow2',id=191467a6-4de0-4308-a62e-cc5ed7bbd05e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1002806692-shelved',owner='30c132beeb2d43b1b568da4492f2ffc9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T13:44:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZRaUkpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:46:33 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:46:33 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:46:33 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260" returned: 21 in 0.075s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9485998-28ef-45bd-80bd-c820b75e6736]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:46:33 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[17846fa4-2dc6-433b-830b-0cc0610b71d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97] added
Jul 27 13:46:33 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4dbe8d-d2ec-4e81-af87-8b91bff7e9a7]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd452f54-7bbd-4071-b4a4-545775ba11f8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZRaUkpN {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZRaUkpN" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c3526d-d2be-441f-b946-becf7bf9b9c1]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gZRaUkpN'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9623ab9-128f-4f75-ad26-097130c4a781]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6216386e-b18d-439a-86b1-d6a772b6c70b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:46:33 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:33 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:33 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:46:33 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:46:33 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:33 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:33 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:46:33 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:46:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[69febb92-c02b-43d1-816e-63976df7ed4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97, portal: 172.16.0.220,3260]
Jul 27 13:46:34 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97, portal: 172.16.0.220,3260] successful.
Jul 27 13:46:34 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b2b389-5919-4298-b968-4493d0d17055]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bb175c-2f15-4119-aa90-42894c79af10]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:46:34 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:34 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:34 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:46:34 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:46:34 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:46:34 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:34 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:34 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:46:34 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:46:34 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be8c261-f802-4803-9a3f-e60310a48700]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZRaUkpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:46:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26633616133393730', 'path': '/dev/sdf'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633616133393730', 'path': '/dev/sdf'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1002806692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1002806692',id=24,image_ref='191467a6-4de0-4308-a62e-cc5ed7bbd05e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1688577340',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:42:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-2uukqca4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member',shelved_at='2023-07-27T13:44:30.232019',shelved_host='user',shelved_image_id='191467a6-4de0-4308-a62e-cc5ed7bbd05e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=4e856bc3-ce45-4307-af2b-33c82ed1eccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:46:35 user nova-compute[70914]:   <uuid>4e856bc3-ce45-4307-af2b-33c82ed1eccc</uuid>
Jul 27 13:46:35 user nova-compute[70914]:   <name>instance-00000018</name>
Jul 27 13:46:35 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:46:35 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:46:35 user nova-compute[70914]:   <metadata>
Jul 27 13:46:35 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:46:35 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:46:35 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1002806692</nova:name>
Jul 27 13:46:35 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:46:33</nova:creationTime>
Jul 27 13:46:35 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:46:35 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:46:35 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:46:35 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:46:35 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:46:35 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:46:35 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:46:35 user nova-compute[70914]:       <nova:owner>
Jul 27 13:46:35 user nova-compute[70914]:         <nova:user uuid="ce42c397b5d44afd9c12497b2bf40fb5">tempest-AttachVolumeShelveTestJSON-90363656-project-member</nova:user>
Jul 27 13:46:35 user nova-compute[70914]:         <nova:project uuid="30c132beeb2d43b1b568da4492f2ffc9">tempest-AttachVolumeShelveTestJSON-90363656</nova:project>
Jul 27 13:46:35 user nova-compute[70914]:       </nova:owner>
Jul 27 13:46:35 user nova-compute[70914]:       <nova:root type="image" uuid="191467a6-4de0-4308-a62e-cc5ed7bbd05e"/>
Jul 27 13:46:35 user nova-compute[70914]:       <nova:ports>
Jul 27 13:46:35 user nova-compute[70914]:         <nova:port uuid="ef1f245c-0a46-4cd8-8851-c93741559d97">
Jul 27 13:46:35 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 13:46:35 user nova-compute[70914]:         </nova:port>
Jul 27 13:46:35 user nova-compute[70914]:       </nova:ports>
Jul 27 13:46:35 user nova-compute[70914]:     </nova:instance>
Jul 27 13:46:35 user nova-compute[70914]:   </metadata>
Jul 27 13:46:35 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:46:35 user nova-compute[70914]:     <system>
Jul 27 13:46:35 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:46:35 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:46:35 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:46:35 user nova-compute[70914]:       <entry name="serial">4e856bc3-ce45-4307-af2b-33c82ed1eccc</entry>
Jul 27 13:46:35 user nova-compute[70914]:       <entry name="uuid">4e856bc3-ce45-4307-af2b-33c82ed1eccc</entry>
Jul 27 13:46:35 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:46:35 user nova-compute[70914]:     </system>
Jul 27 13:46:35 user nova-compute[70914]:   </sysinfo>
Jul 27 13:46:35 user nova-compute[70914]:   <os>
Jul 27 13:46:35 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:46:35 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:46:35 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:46:35 user nova-compute[70914]:   </os>
Jul 27 13:46:35 user nova-compute[70914]:   <features>
Jul 27 13:46:35 user nova-compute[70914]:     <acpi/>
Jul 27 13:46:35 user nova-compute[70914]:     <apic/>
Jul 27 13:46:35 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:46:35 user nova-compute[70914]:   </features>
Jul 27 13:46:35 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:46:35 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:46:35 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:46:35 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:46:35 user nova-compute[70914]:   </clock>
Jul 27 13:46:35 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:46:35 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:46:35 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:46:35 user nova-compute[70914]:   </cpu>
Jul 27 13:46:35 user nova-compute[70914]:   <devices>
Jul 27 13:46:35 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:46:35 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:46:35 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk"/>
Jul 27 13:46:35 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:46:35 user nova-compute[70914]:     </disk>
Jul 27 13:46:35 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:46:35 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:46:35 user nova-compute[70914]:       <source dev="/dev/sdf"/>
Jul 27 13:46:35 user nova-compute[70914]:       <target dev="vdc" bus="virtio"/>
Jul 27 13:46:35 user nova-compute[70914]:       <serial>6f2203aa-baa2-4a45-8081-82734d7bdd97</serial>
Jul 27 13:46:35 user nova-compute[70914]:     </disk>
Jul 27 13:46:35 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:46:35 user nova-compute[70914]:       <mac address="fa:16:3e:7e:b8:3f"/>
Jul 27 13:46:35 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:46:35 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:46:35 user nova-compute[70914]:       <target dev="tapef1f245c-0a"/>
Jul 27 13:46:35 user nova-compute[70914]:     </interface>
Jul 27 13:46:35 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:46:35 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/console.log" append="off"/>
Jul 27 13:46:35 user nova-compute[70914]:     </serial>
Jul 27 13:46:35 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:46:35 user nova-compute[70914]:     <video>
Jul 27 13:46:35 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:46:35 user nova-compute[70914]:     </video>
Jul 27 13:46:35 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:46:35 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:46:35 user nova-compute[70914]:     </rng>
Jul 27 13:46:35 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:46:35 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:46:35 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:46:35 user nova-compute[70914]:     </memballoon>
Jul 27 13:46:35 user nova-compute[70914]:   </devices>
Jul 27 13:46:35 user nova-compute[70914]: </domain>
Jul 27 13:46:35 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1002806692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1002806692',id=24,image_ref='191467a6-4de0-4308-a62e-cc5ed7bbd05e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1688577340',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:42:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-2uukqca4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member',shelved_at='2023-07-27T13:44:30.232019',shelved_host='user',shelved_image_id='191467a6-4de0-4308-a62e-cc5ed7bbd05e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=4e856bc3-ce45-4307-af2b-33c82ed1eccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG os_vif [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef1f245c-0a, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef1f245c-0a, col_values=(('external_ids', {'iface-id': 'ef1f245c-0a46-4cd8-8851-c93741559d97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:b8:3f', 'vm-uuid': '4e856bc3-ce45-4307-af2b-33c82ed1eccc'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:35 user nova-compute[70914]: INFO os_vif [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a')
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:46:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] No VIF found with MAC fa:16:3e:7e:b8:3f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:46:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-3a3ac97f-c753-4be8-a39d-9862e543f28d req-3d809640-0746-44a1-b2ca-f4fc714cc866 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-changed-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-3a3ac97f-c753-4be8-a39d-9862e543f28d req-3d809640-0746-44a1-b2ca-f4fc714cc866 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Refreshing instance network info cache due to event network-changed-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:46:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3a3ac97f-c753-4be8-a39d-9862e543f28d req-3d809640-0746-44a1-b2ca-f4fc714cc866 service nova] Acquiring lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:46:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3a3ac97f-c753-4be8-a39d-9862e543f28d req-3d809640-0746-44a1-b2ca-f4fc714cc866 service nova] Acquired lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:46:36 user nova-compute[70914]: DEBUG nova.network.neutron [req-3a3ac97f-c753-4be8-a39d-9862e543f28d req-3d809640-0746-44a1-b2ca-f4fc714cc866 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Refreshing network info cache for port bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:46:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:37 user nova-compute[70914]: INFO nova.compute.manager [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Detaching volume d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174
Jul 27 13:46:37 user nova-compute[70914]: INFO nova.virt.block_device [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Attempting to driver detach volume d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 from mountpoint /dev/vdb
Jul 27 13:46:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Attempting to detach device vdb from instance 30050776-6e41-487a-9ad2-342b18a7b72f from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:46:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:46:37 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:46:37 user nova-compute[70914]:   <source dev="/dev/sdd"/>
Jul 27 13:46:37 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:46:37 user nova-compute[70914]:   <serial>d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174</serial>
Jul 27 13:46:37 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:46:37 user nova-compute[70914]: </disk>
Jul 27 13:46:37 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:46:37 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Successfully detached device vdb from instance 30050776-6e41-487a-9ad2-342b18a7b72f from the persistent domain config.
Jul 27 13:46:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30050776-6e41-487a-9ad2-342b18a7b72f from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:46:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:46:37 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:46:37 user nova-compute[70914]:   <source dev="/dev/sdd"/>
Jul 27 13:46:37 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:46:37 user nova-compute[70914]:   <serial>d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174</serial>
Jul 27 13:46:37 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:46:37 user nova-compute[70914]: </disk>
Jul 27 13:46:37 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.network.neutron [req-3a3ac97f-c753-4be8-a39d-9862e543f28d req-3d809640-0746-44a1-b2ca-f4fc714cc866 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updated VIF entry in instance network info cache for port bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.network.neutron [req-3a3ac97f-c753-4be8-a39d-9862e543f28d req-3d809640-0746-44a1-b2ca-f4fc714cc866 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updating instance_info_cache with network_info: [{"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3a3ac97f-c753-4be8-a39d-9862e543f28d req-3d809640-0746-44a1-b2ca-f4fc714cc866 service nova] Releasing lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465598.5295837, 30050776-6e41-487a-9ad2-342b18a7b72f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:46:38 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Successfully detached device vdb from instance 30050776-6e41-487a-9ad2-342b18a7b72f from the live domain config.
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdxtnsAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:46:38 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3f4244-f807-4290-ad52-f03254b773da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:46:38 user nova-compute[70914]: No targets found.
Jul 27 13:46:38 user nova-compute[70914]: iSNS:
Jul 27 13:46:38 user nova-compute[70914]: No targets found.
Jul 27 13:46:38 user nova-compute[70914]: STATIC:
Jul 27 13:46:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188
Jul 27 13:46:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:46:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:46:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174
Jul 27 13:46:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:46:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:46:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97
Jul 27 13:46:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:46:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:46:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:46:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:46:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:46:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3
Jul 27 13:46:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:46:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:46:38 user nova-compute[70914]: FIRMWARE:
Jul 27 13:46:38 user nova-compute[70914]: No targets found.
Jul 27 13:46:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:46:38 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:46:38 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a08ccc-b910-4154-b934-7606f568be5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-changed-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Refreshing instance network info cache due to event network-changed-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] Acquiring lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] Acquired lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.network.neutron [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Refreshing network info cache for port bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7c116c-6b9d-4f60-b854-41ef046fb95b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:46:38 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:38 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:38 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:46:38 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:46:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 (non-flash)
Jul 27 13:46:38 user nova-compute[70914]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:38 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:38 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:46:38 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:46:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c381a9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174'): ({'sdd'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Removing single pathed devices sdd {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-46199afe-d468-4745-b402-ca99696793e6 req-41a22707-6eec-4622-bc1a-2708ec25f13f service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-changed-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-46199afe-d468-4745-b402-ca99696793e6 req-41a22707-6eec-4622-bc1a-2708ec25f13f service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Refreshing instance network info cache due to event network-changed-4252cbc5-88bf-446c-abdb-46c174a0afa6. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-46199afe-d468-4745-b402-ca99696793e6 req-41a22707-6eec-4622-bc1a-2708ec25f13f service nova] Acquiring lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-46199afe-d468-4745-b402-ca99696793e6 req-41a22707-6eec-4622-bc1a-2708ec25f13f service nova] Acquired lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG nova.network.neutron [req-46199afe-d468-4745-b402-ca99696793e6 req-41a22707-6eec-4622-bc1a-2708ec25f13f service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Refreshing network info cache for port 4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4082266-1cc9-414d-94ac-8382b56c4816]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdafbde-72b2-4a2c-bd21-ba8db1df6db6]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Flushing IO for device /dev/sdd {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d876dcf8-d815-488c-8765-29758517895f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.070s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b192c1-ee41-48c5-a0e4-b40b5505f923]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ce5b18-8f07-431f-a6ac-1d95e459ae26]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e7140-4921-43c4-9762-149f4e9694c7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174, portal: 172.16.0.220,3260]
Jul 27 13:46:38 user nova-compute[70914]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174, portal: 172.16.0.220,3260] successful.
Jul 27 13:46:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7d2bd-82ac-4e3e-b8a2-e1dc4a8d7174 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55945ca-7283-41f9-bf63-32e91b4c602f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] <== disconnect_volume: return (436ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updated VIF entry in instance network info cache for port bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updating instance_info_cache with network_info: [{"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] Releasing lock "refresh_cache-30050776-6e41-487a-9ad2-342b18a7b72f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] No waiting events found dispatching network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:46:39 user nova-compute[70914]: WARNING nova.compute.manager [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received unexpected event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 13:46:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] No waiting events found dispatching network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:46:39 user nova-compute[70914]: WARNING nova.compute.manager [req-caeef780-97a6-4d3c-9f68-2d72b97ac33f req-e6fff66b-5294-4900-8b70-0c49625e53d5 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received unexpected event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 13:46:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-46199afe-d468-4745-b402-ca99696793e6 req-41a22707-6eec-4622-bc1a-2708ec25f13f service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updated VIF entry in instance network info cache for port 4252cbc5-88bf-446c-abdb-46c174a0afa6. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-46199afe-d468-4745-b402-ca99696793e6 req-41a22707-6eec-4622-bc1a-2708ec25f13f service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updating instance_info_cache with network_info: [{"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:46:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-46199afe-d468-4745-b402-ca99696793e6 req-41a22707-6eec-4622-bc1a-2708ec25f13f service nova] Releasing lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465600.082245, 4e856bc3-ce45-4307-af2b-33c82ed1eccc => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:46:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] VM Resumed (Lifecycle Event)
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'flavor' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:46:40 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Instance spawned successfully.
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7871fc18-42bf-42c3-815f-eedff4c4f376 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.449s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:46:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465600.084243, 4e856bc3-ce45-4307-af2b-33c82ed1eccc => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:46:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] VM Started (Lifecycle Event)
Jul 27 13:46:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:46:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:40 user nova-compute[70914]: INFO nova.compute.manager [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Detaching volume 92a085ff-339a-4b95-a1fb-6ac855b1a188
Jul 27 13:46:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724210b3-cc1a-4319-a4d6-1d360ca927fd tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.848s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:40 user nova-compute[70914]: INFO nova.virt.block_device [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Attempting to driver detach volume 92a085ff-339a-4b95-a1fb-6ac855b1a188 from mountpoint /dev/vdb
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Attempting to detach device vdb from instance 0371b280-fc39-4cbd-b496-ba78fea4e856 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:46:40 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:46:40 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:46:40 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:46:40 user nova-compute[70914]:   <serial>92a085ff-339a-4b95-a1fb-6ac855b1a188</serial>
Jul 27 13:46:40 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 13:46:40 user nova-compute[70914]: </disk>
Jul 27 13:46:40 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:46:40 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Successfully detached device vdb from instance 0371b280-fc39-4cbd-b496-ba78fea4e856 from the persistent domain config.
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0371b280-fc39-4cbd-b496-ba78fea4e856 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:46:40 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:46:40 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:46:40 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:46:40 user nova-compute[70914]:   <serial>92a085ff-339a-4b95-a1fb-6ac855b1a188</serial>
Jul 27 13:46:40 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 13:46:40 user nova-compute[70914]: </disk>
Jul 27 13:46:40 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-08adbc92-d259-4c99-aba9-001ee1afe45d req-53171e1d-8646-4689-b81b-7e687cb76789 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-changed-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-08adbc92-d259-4c99-aba9-001ee1afe45d req-53171e1d-8646-4689-b81b-7e687cb76789 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Refreshing instance network info cache due to event network-changed-4252cbc5-88bf-446c-abdb-46c174a0afa6. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-08adbc92-d259-4c99-aba9-001ee1afe45d req-53171e1d-8646-4689-b81b-7e687cb76789 service nova] Acquiring lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-08adbc92-d259-4c99-aba9-001ee1afe45d req-53171e1d-8646-4689-b81b-7e687cb76789 service nova] Acquired lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:46:40 user nova-compute[70914]: DEBUG nova.network.neutron [req-08adbc92-d259-4c99-aba9-001ee1afe45d req-53171e1d-8646-4689-b81b-7e687cb76789 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Refreshing network info cache for port 4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465601.2693453, 0371b280-fc39-4cbd-b496-ba78fea4e856 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:46:41 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Successfully detached device vdb from instance 0371b280-fc39-4cbd-b496-ba78fea4e856 from the live domain config.
Jul 27 13:46:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZsyQJeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:46:41 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-08adbc92-d259-4c99-aba9-001ee1afe45d req-53171e1d-8646-4689-b81b-7e687cb76789 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updated VIF entry in instance network info cache for port 4252cbc5-88bf-446c-abdb-46c174a0afa6. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-08adbc92-d259-4c99-aba9-001ee1afe45d req-53171e1d-8646-4689-b81b-7e687cb76789 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updating instance_info_cache with network_info: [{"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-08adbc92-d259-4c99-aba9-001ee1afe45d req-53171e1d-8646-4689-b81b-7e687cb76789 service nova] Releasing lock "refresh_cache-0371b280-fc39-4cbd-b496-ba78fea4e856" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cc67e3-aa80-4b1b-acb7-0880b07b2738]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:46:41 user nova-compute[70914]: No targets found.
Jul 27 13:46:41 user nova-compute[70914]: iSNS:
Jul 27 13:46:41 user nova-compute[70914]: No targets found.
Jul 27 13:46:41 user nova-compute[70914]: STATIC:
Jul 27 13:46:41 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188
Jul 27 13:46:41 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:46:41 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:46:41 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97
Jul 27 13:46:41 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:46:41 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:46:41 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:46:41 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:46:41 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:46:41 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3
Jul 27 13:46:41 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:46:41 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:46:41 user nova-compute[70914]: FIRMWARE:
Jul 27 13:46:41 user nova-compute[70914]: No targets found.
Jul 27 13:46:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:46:41 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:46:41 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[92279a46-31a6-4916-9292-95ec9c0dd83f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77287d1-c5df-45c9-8773-4f370c2d6916]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:41 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:41 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:46:41 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:46:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:46:41 user nova-compute[70914]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 (non-flash)
Jul 27 13:46:41 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:46:41 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:46:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18601ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edd47ea-7c4e-479c-b816-c3b89c1aa3e0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bce8d58-c32e-4a9d-b794-2a074b6d3093]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a89335-e486-4ada-b44e-e82269c2fdbb]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d08f78-5e86-409e-ab40-db98f717d8bc]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f8550-2c65-4bd2-beb1-4722e1940529]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b099cb44-512d-43c8-aca0-1fd5358b0c15]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260]
Jul 27 13:46:41 user nova-compute[70914]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188, portal: 172.16.0.220,3260] successful.
Jul 27 13:46:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92a085ff-339a-4b95-a1fb-6ac855b1a188 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c4d358-a7fd-4760-95aa-ab99489ae784]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] <== disconnect_volume: return (384ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:46:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:46:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:42 user nova-compute[70914]: DEBUG nova.objects.instance [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'flavor' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:46:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-11a5df5b-103b-4a3a-b336-4dc923f9b82d tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.146s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:46:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:43 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:46:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:46:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:46:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:46:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:46:48 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:46:48 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7197MB free_disk=25.242568969726562GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 30050776-6e41-487a-9ad2-342b18a7b72f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0371b280-fc39-4cbd-b496-ba78fea4e856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cbf6d0ec-b91d-4db5-b863-156754c746bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance d1f1d62d-885b-47b9-8d4d-972da97cba2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3b8cffe7-b0ad-487b-8229-54469afefdd2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:46:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:46:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:46:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:46:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:46:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:46:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:46:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:46:51 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:46:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:46:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:46:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:46:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:46:52 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:46:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updating instance_info_cache with network_info: [{"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:46:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-e45fbfcb-0107-4410-b5e1-71ba56995748" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:46:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:46:53 user nova-compute[70914]: INFO nova.compute.manager [None req-0ffc2b2e-4f57-4e43-b5ff-58d64f487502 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Unrescuing
Jul 27 13:46:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0ffc2b2e-4f57-4e43-b5ff-58d64f487502 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:46:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0ffc2b2e-4f57-4e43-b5ff-58d64f487502 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquired lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:46:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0ffc2b2e-4f57-4e43-b5ff-58d64f487502 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:46:54 user nova-compute[70914]: DEBUG nova.network.neutron [None req-0ffc2b2e-4f57-4e43-b5ff-58d64f487502 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updating instance_info_cache with network_info: [{"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:46:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0ffc2b2e-4f57-4e43-b5ff-58d64f487502 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Releasing lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:46:54 user nova-compute[70914]: DEBUG nova.objects.instance [None req-0ffc2b2e-4f57-4e43-b5ff-58d64f487502 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'flavor' on Instance uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:46:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-7f7ebaba-421d-4364-95d6-251ca8442562 req-9927d19d-14f5-49b0-abe6-58714329fee6 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-unplugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7f7ebaba-421d-4364-95d6-251ca8442562 req-9927d19d-14f5-49b0-abe6-58714329fee6 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7f7ebaba-421d-4364-95d6-251ca8442562 req-9927d19d-14f5-49b0-abe6-58714329fee6 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7f7ebaba-421d-4364-95d6-251ca8442562 req-9927d19d-14f5-49b0-abe6-58714329fee6 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-7f7ebaba-421d-4364-95d6-251ca8442562 req-9927d19d-14f5-49b0-abe6-58714329fee6 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-unplugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:46:55 user nova-compute[70914]: WARNING nova.compute.manager [req-7f7ebaba-421d-4364-95d6-251ca8442562 req-9927d19d-14f5-49b0-abe6-58714329fee6 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-unplugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:46:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:55 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Instance destroyed successfully.
Jul 27 13:46:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:46:57 user nova-compute[70914]: WARNING nova.compute.manager [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:46:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:46:57 user nova-compute[70914]: WARNING nova.compute.manager [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:46:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:46:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:46:57 user nova-compute[70914]: WARNING nova.compute.manager [req-0a4c0b18-e3d7-497d-ab91-aca48820abe9 req-da778b67-1595-48eb-a328-bcf6c8e72504 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:46:58 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:46:58 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465618.8172545, 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:46:58 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] VM Resumed (Lifecycle Event)
Jul 27 13:46:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0ffc2b2e-4f57-4e43-b5ff-58d64f487502 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:46:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:46:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:46:58 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 13:46:58 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465618.824405, 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:46:58 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] VM Started (Lifecycle Event)
Jul 27 13:46:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:46:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:46:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:28 user nova-compute[70914]: INFO nova.compute.manager [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Terminating instance
Jul 27 13:47:28 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a6035c2-53be-4629-8a5e-881d9dd67d14 req-1c7fb204-dbe7-4761-bb20-6db9595f6955 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-unplugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a6035c2-53be-4629-8a5e-881d9dd67d14 req-1c7fb204-dbe7-4761-bb20-6db9595f6955 service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a6035c2-53be-4629-8a5e-881d9dd67d14 req-1c7fb204-dbe7-4761-bb20-6db9595f6955 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a6035c2-53be-4629-8a5e-881d9dd67d14 req-1c7fb204-dbe7-4761-bb20-6db9595f6955 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a6035c2-53be-4629-8a5e-881d9dd67d14 req-1c7fb204-dbe7-4761-bb20-6db9595f6955 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-unplugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a6035c2-53be-4629-8a5e-881d9dd67d14 req-1c7fb204-dbe7-4761-bb20-6db9595f6955 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-unplugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Instance destroyed successfully.
Jul 27 13:47:28 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'resources' on Instance uuid 30050776-6e41-487a-9ad2-342b18a7b72f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:40:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1493132680',display_name='tempest-ServerRescueNegativeTestJSON-server-1493132680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1493132680',id=21,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4wmNCkvYQYQ0qqix7wjwraQUsjHfZUo2ooBlM3iiRvi9NS0tf/RJ3lGNtR1r32zT+z7zkJqc3A8Zl6Yst1/6kaDIzOgs0nZKK5GNuqF6wrVURh+o6c7Be54NVRq1bOuA==',key_name='tempest-keypair-1352200146',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:42:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-ndqp4fiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d92b0b34814e75a7709e09e357be07',uuid=30050776-6e41-487a-9ad2-342b18a7b72f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "address": "fa:16:3e:88:40:9d", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb7b48a-92", "ovs_interfaceid": "bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:40:9d,bridge_name='br-int',has_traffic_filtering=True,id=bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb7b48a-92') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG os_vif [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:40:9d,bridge_name='br-int',has_traffic_filtering=True,id=bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb7b48a-92') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfb7b48a-92, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:47:28 user nova-compute[70914]: INFO os_vif [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:40:9d,bridge_name='br-int',has_traffic_filtering=True,id=bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb7b48a-92')
Jul 27 13:47:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Deleting instance files /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f_del
Jul 27 13:47:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Deletion of /opt/stack/data/nova/instances/30050776-6e41-487a-9ad2-342b18a7b72f_del complete
Jul 27 13:47:29 user nova-compute[70914]: INFO nova.compute.manager [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Took 1.00 seconds to destroy the instance on the hypervisor.
Jul 27 13:47:29 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:47:29 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:47:29 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:47:30 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Took 1.21 seconds to deallocate network for instance.
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-99cddf9d-6561-42ec-86fb-a3d02b216925 req-18a65ed7-0dcc-4ada-a0cd-d68707bd763f service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-changed-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-99cddf9d-6561-42ec-86fb-a3d02b216925 req-18a65ed7-0dcc-4ada-a0cd-d68707bd763f service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Refreshing instance network info cache due to event network-changed-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-99cddf9d-6561-42ec-86fb-a3d02b216925 req-18a65ed7-0dcc-4ada-a0cd-d68707bd763f service nova] Acquiring lock "refresh_cache-cbf6d0ec-b91d-4db5-b863-156754c746bc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-99cddf9d-6561-42ec-86fb-a3d02b216925 req-18a65ed7-0dcc-4ada-a0cd-d68707bd763f service nova] Acquired lock "refresh_cache-cbf6d0ec-b91d-4db5-b863-156754c746bc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG nova.network.neutron [req-99cddf9d-6561-42ec-86fb-a3d02b216925 req-18a65ed7-0dcc-4ada-a0cd-d68707bd763f service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Refreshing network info cache for port c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-50d1a692-6aca-4873-812d-00a037770dda req-73544cf2-714f-4589-b69e-7f46744cf4e2 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-50d1a692-6aca-4873-812d-00a037770dda req-73544cf2-714f-4589-b69e-7f46744cf4e2 service nova] Acquiring lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-50d1a692-6aca-4873-812d-00a037770dda req-73544cf2-714f-4589-b69e-7f46744cf4e2 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-50d1a692-6aca-4873-812d-00a037770dda req-73544cf2-714f-4589-b69e-7f46744cf4e2 service nova] Lock "30050776-6e41-487a-9ad2-342b18a7b72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-50d1a692-6aca-4873-812d-00a037770dda req-73544cf2-714f-4589-b69e-7f46744cf4e2 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] No waiting events found dispatching network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:47:30 user nova-compute[70914]: WARNING nova.compute.manager [req-50d1a692-6aca-4873-812d-00a037770dda req-73544cf2-714f-4589-b69e-7f46744cf4e2 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received unexpected event network-vif-plugged-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b for instance with vm_state deleted and task_state None.
Jul 27 13:47:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-50d1a692-6aca-4873-812d-00a037770dda req-73544cf2-714f-4589-b69e-7f46744cf4e2 service nova] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Received event network-vif-deleted-bfb7b48a-92a6-4ea9-a8cd-8ff61c803d0b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'flavor' on Instance uuid cbf6d0ec-b91d-4db5-b863-156754c746bc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:47:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Ignoring supplied device name: /dev/vdb
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:30 user nova-compute[70914]: INFO nova.compute.manager [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Attaching volume f361b3d4-e058-4a11-b17e-b76cd0060c25 to /dev/vdb
Jul 27 13:47:30 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Deleted allocations for instance 30050776-6e41-487a-9ad2-342b18a7b72f
Jul 27 13:47:30 user nova-compute[70914]: DEBUG os_brick.utils [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac2fd0a-c717-4ab0-ad97-c500ec56bc9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:30 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c15157f-bdba-4470-85a6-5caf1ac574fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1192690e-5c86-405a-94a9-e89f06e78bf0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63406ed-3807-474b-87db-4e309e6208e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG nova.network.neutron [req-99cddf9d-6561-42ec-86fb-a3d02b216925 req-18a65ed7-0dcc-4ada-a0cd-d68707bd763f service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Updated VIF entry in instance network info cache for port c1ae2dfc-c734-4be9-bdd3-568940fbeb0a. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG nova.network.neutron [req-99cddf9d-6561-42ec-86fb-a3d02b216925 req-18a65ed7-0dcc-4ada-a0cd-d68707bd763f service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Updating instance_info_cache with network_info: [{"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:47:31 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c377eaa7-d129-42ba-883c-0016ff069342]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c4d3387a-8059-40c5-8735-da6cdc461d20 tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "30050776-6e41-487a-9ad2-342b18a7b72f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.055s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG os_brick.utils [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Updating existing volume attachment record: 60d77391-5845-421a-8d74-5ecfdf52db74 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:47:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-99cddf9d-6561-42ec-86fb-a3d02b216925 req-18a65ed7-0dcc-4ada-a0cd-d68707bd763f service nova] Releasing lock "refresh_cache-cbf6d0ec-b91d-4db5-b863-156754c746bc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:47:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:35 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 13:47:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] There are 0 instances to clean {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:38 user nova-compute[70914]: INFO nova.compute.manager [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Terminating instance
Jul 27 13:47:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-fad6a7e9-8cd3-4337-90bc-59c614b59502 req-64d8801d-b995-4b7c-98f0-6ad31cf6f55c service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Received event network-vif-unplugged-52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fad6a7e9-8cd3-4337-90bc-59c614b59502 req-64d8801d-b995-4b7c-98f0-6ad31cf6f55c service nova] Acquiring lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fad6a7e9-8cd3-4337-90bc-59c614b59502 req-64d8801d-b995-4b7c-98f0-6ad31cf6f55c service nova] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fad6a7e9-8cd3-4337-90bc-59c614b59502 req-64d8801d-b995-4b7c-98f0-6ad31cf6f55c service nova] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-fad6a7e9-8cd3-4337-90bc-59c614b59502 req-64d8801d-b995-4b7c-98f0-6ad31cf6f55c service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] No waiting events found dispatching network-vif-unplugged-52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-fad6a7e9-8cd3-4337-90bc-59c614b59502 req-64d8801d-b995-4b7c-98f0-6ad31cf6f55c service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Received event network-vif-unplugged-52e6d29e-16ee-4279-889c-cbfbb57004bf for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:47:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Instance destroyed successfully.
Jul 27 13:47:39 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lazy-loading 'resources' on Instance uuid d1f1d62d-885b-47b9-8d4d-972da97cba2f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-826268357',display_name='tempest-VolumesActionsTest-instance-826268357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-826268357',id=29,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bca794885b0f49cf84038cd7c3edf9ee',ramdisk_id='',reservation_id='r-xfcybgxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1110307362',owner_user_name='tempest-VolumesActionsTest-1110307362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:45:54Z,user_data=None,user_id='52e4c423609f4481b1634fbaca3e7ddb',uuid=d1f1d62d-885b-47b9-8d4d-972da97cba2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "address": "fa:16:3e:88:49:25", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e6d29e-16", "ovs_interfaceid": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converting VIF {"id": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "address": "fa:16:3e:88:49:25", "network": {"id": "bf30aa86-f9e7-4cc3-a980-2f683f0ac243", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1198461805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca794885b0f49cf84038cd7c3edf9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e6d29e-16", "ovs_interfaceid": "52e6d29e-16ee-4279-889c-cbfbb57004bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:49:25,bridge_name='br-int',has_traffic_filtering=True,id=52e6d29e-16ee-4279-889c-cbfbb57004bf,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e6d29e-16') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG os_vif [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:49:25,bridge_name='br-int',has_traffic_filtering=True,id=52e6d29e-16ee-4279-889c-cbfbb57004bf,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e6d29e-16') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52e6d29e-16, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:47:39 user nova-compute[70914]: INFO os_vif [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:49:25,bridge_name='br-int',has_traffic_filtering=True,id=52e6d29e-16ee-4279-889c-cbfbb57004bf,network=Network(bf30aa86-f9e7-4cc3-a980-2f683f0ac243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e6d29e-16')
Jul 27 13:47:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Deleting instance files /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f_del
Jul 27 13:47:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Deletion of /opt/stack/data/nova/instances/d1f1d62d-885b-47b9-8d4d-972da97cba2f_del complete
Jul 27 13:47:39 user nova-compute[70914]: INFO nova.compute.manager [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 27 13:47:39 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:47:39 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Took 0.59 seconds to deallocate network for instance.
Jul 27 13:47:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-fa473112-59a3-4bfd-a829-8ff686c5dab2 req-d65742c1-583c-4690-b426-972cb0bc257c service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Received event network-vif-deleted-52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:40 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:47:40 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:47:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:40 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Deleted allocations for instance d1f1d62d-885b-47b9-8d4d-972da97cba2f
Jul 27 13:47:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7ba3035c-5e80-47f5-8bd9-3ecc99946bed tempest-VolumesActionsTest-1110307362 tempest-VolumesActionsTest-1110307362-project-member] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.104s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-8b44f126-a7ef-414c-9e09-770f37787fc1 req-2e328f5f-395e-4f84-b794-392ea358de45 service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Received event network-vif-plugged-52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8b44f126-a7ef-414c-9e09-770f37787fc1 req-2e328f5f-395e-4f84-b794-392ea358de45 service nova] Acquiring lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8b44f126-a7ef-414c-9e09-770f37787fc1 req-2e328f5f-395e-4f84-b794-392ea358de45 service nova] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8b44f126-a7ef-414c-9e09-770f37787fc1 req-2e328f5f-395e-4f84-b794-392ea358de45 service nova] Lock "d1f1d62d-885b-47b9-8d4d-972da97cba2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-8b44f126-a7ef-414c-9e09-770f37787fc1 req-2e328f5f-395e-4f84-b794-392ea358de45 service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] No waiting events found dispatching network-vif-plugged-52e6d29e-16ee-4279-889c-cbfbb57004bf {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:47:40 user nova-compute[70914]: WARNING nova.compute.manager [req-8b44f126-a7ef-414c-9e09-770f37787fc1 req-2e328f5f-395e-4f84-b794-392ea358de45 service nova] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Received unexpected event network-vif-plugged-52e6d29e-16ee-4279-889c-cbfbb57004bf for instance with vm_state deleted and task_state None.
Jul 27 13:47:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtAFsLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:47:43 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:47:43 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:47:43 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[12637085-7c69-4b3b-ad70-bd2532732366]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:47:43 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[734862a1-68d5-4ceb-ad0a-4dadf2927ee4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25] added
Jul 27 13:47:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d23e390-ccfe-4ab7-a31e-28101d77f4b8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb342a61-fbd3-47a0-89c1-1c711c154d0e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtAFsLJl {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtAFsLJl" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9838a44-dbff-4c69-b487-7c44538bc28b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtAFsLJl'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d008cdca-7b84-4505-b541-cbd8916347bf]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4531098c-f8be-4d4b-b479-74a7f1b3cc56]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:47:43 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:47:43 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:47:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:47:43 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:47:43 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:47:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1b574d-9eee-46ef-9028-4d966fcb4614]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25, portal: 172.16.0.220,3260]
Jul 27 13:47:43 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25, portal: 172.16.0.220,3260] successful.
Jul 27 13:47:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1701483-c346-49e8-87e3-452adc5e2caa]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[668003aa-6917-41fd-9c7b-25f2b6f7a2dc]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:47:43 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:47:43 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:47:43 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:47:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:47:43 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:47:43 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:47:43 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:47:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a3ef21-350d-4ed0-90f7-164f28dc6cd6]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtAFsLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:47:43 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465648.8840814, 30050776-6e41-487a-9ad2-342b18a7b72f => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:47:43 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] VM Stopped (Lifecycle Event)
Jul 27 13:47:43 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9f0bd2f1-4f99-485b-b28e-a788d6879d27 None None] [instance: 30050776-6e41-487a-9ad2-342b18a7b72f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:44 user nova-compute[70914]: INFO nova.compute.manager [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Terminating instance
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-3c68ffad-ce3f-4d8b-9f9c-cf1b9047c520 req-b83125c3-c5bf-494d-83d3-fef4b94df85b service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-vif-unplugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3c68ffad-ce3f-4d8b-9f9c-cf1b9047c520 req-b83125c3-c5bf-494d-83d3-fef4b94df85b service nova] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3c68ffad-ce3f-4d8b-9f9c-cf1b9047c520 req-b83125c3-c5bf-494d-83d3-fef4b94df85b service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3c68ffad-ce3f-4d8b-9f9c-cf1b9047c520 req-b83125c3-c5bf-494d-83d3-fef4b94df85b service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-3c68ffad-ce3f-4d8b-9f9c-cf1b9047c520 req-b83125c3-c5bf-494d-83d3-fef4b94df85b service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] No waiting events found dispatching network-vif-unplugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-3c68ffad-ce3f-4d8b-9f9c-cf1b9047c520 req-b83125c3-c5bf-494d-83d3-fef4b94df85b service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-vif-unplugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23766653131373438', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766653131373438', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.objects.instance [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'flavor' on Instance uuid cbf6d0ec-b91d-4db5-b863-156754c746bc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:47:44 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:47:44 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:47:44 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:47:44 user nova-compute[70914]:   <serial>f361b3d4-e058-4a11-b17e-b76cd0060c25</serial>
Jul 27 13:47:44 user nova-compute[70914]: </disk>
Jul 27 13:47:44 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:47:44 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Instance destroyed successfully.
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.objects.instance [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'resources' on Instance uuid 0371b280-fc39-4cbd-b496-ba78fea4e856 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-948322511',display_name='tempest-TestMinimumBasicScenario-server-948322511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-948322511',id=23,image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKgwFRMqg++F6VMttGQOMCdPQ6K0qJzfmdZXVdMWuv9ZYlvkJksIbxDMMfuJdggMi0iYxooQuba5bDy2He7DNtQCGSRS8ITcsjdGfcwf3G6wCYY0GYn+GWFDcsPlWjFug==',key_name='tempest-TestMinimumBasicScenario-2060879644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45941da6cb4b3a8c7394cc649e62e5',ramdisk_id='',reservation_id='r-377gj72q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34c687af-4258-46da-8a45-5258a18fd9d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-779682044',owner_user_name='tempest-TestMinimumBasicScenario-779682044-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:44:53Z,user_data=None,user_id='340b2ab1e12b4e0491b86f3eb2596cd1',uuid=0371b280-fc39-4cbd-b496-ba78fea4e856,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converting VIF {"id": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "address": "fa:16:3e:ff:b5:23", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4252cbc5-88", "ovs_interfaceid": "4252cbc5-88bf-446c-abdb-46c174a0afa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG os_vif [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4252cbc5-88, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:47:44 user nova-compute[70914]: INFO os_vif [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b5:23,bridge_name='br-int',has_traffic_filtering=True,id=4252cbc5-88bf-446c-abdb-46c174a0afa6,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4252cbc5-88')
Jul 27 13:47:44 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Deleting instance files /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856_del
Jul 27 13:47:44 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Deletion of /opt/stack/data/nova/instances/0371b280-fc39-4cbd-b496-ba78fea4e856_del complete
Jul 27 13:47:44 user nova-compute[70914]: INFO nova.compute.manager [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 27 13:47:44 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:47:44 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] No VIF found with MAC fa:16:3e:36:7d:4f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6a363575-5e0a-4d67-a20a-3770dbd7362b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.658s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG nova.compute.manager [req-a8eca474-38ae-4f73-9088-2eacc1ccc2bc req-e4130e12-4b32-4599-b28c-d7be094bbec7 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-vif-deleted-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:45 user nova-compute[70914]: INFO nova.compute.manager [req-a8eca474-38ae-4f73-9088-2eacc1ccc2bc req-e4130e12-4b32-4599-b28c-d7be094bbec7 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Neutron deleted interface 4252cbc5-88bf-446c-abdb-46c174a0afa6; detaching it from the instance and deleting it from the info cache
Jul 27 13:47:45 user nova-compute[70914]: DEBUG nova.network.neutron [req-a8eca474-38ae-4f73-9088-2eacc1ccc2bc req-e4130e12-4b32-4599-b28c-d7be094bbec7 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:47:45 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Took 0.73 seconds to deallocate network for instance.
Jul 27 13:47:45 user nova-compute[70914]: DEBUG nova.compute.manager [req-a8eca474-38ae-4f73-9088-2eacc1ccc2bc req-e4130e12-4b32-4599-b28c-d7be094bbec7 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Detach interface failed, port_id=4252cbc5-88bf-446c-abdb-46c174a0afa6, reason: Instance 0371b280-fc39-4cbd-b496-ba78fea4e856 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:46 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Deleted allocations for instance 0371b280-fc39-4cbd-b496-ba78fea4e856
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-313779c9-5643-48a8-8416-2f48a52b7f06 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.390s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-915f39c0-55d7-4a11-a79a-7936bff80fcb req-e482d856-d215-4740-97c8-e1d8a6134f48 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-915f39c0-55d7-4a11-a79a-7936bff80fcb req-e482d856-d215-4740-97c8-e1d8a6134f48 service nova] Acquiring lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-915f39c0-55d7-4a11-a79a-7936bff80fcb req-e482d856-d215-4740-97c8-e1d8a6134f48 service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-915f39c0-55d7-4a11-a79a-7936bff80fcb req-e482d856-d215-4740-97c8-e1d8a6134f48 service nova] Lock "0371b280-fc39-4cbd-b496-ba78fea4e856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-915f39c0-55d7-4a11-a79a-7936bff80fcb req-e482d856-d215-4740-97c8-e1d8a6134f48 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] No waiting events found dispatching network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:47:46 user nova-compute[70914]: WARNING nova.compute.manager [req-915f39c0-55d7-4a11-a79a-7936bff80fcb req-e482d856-d215-4740-97c8-e1d8a6134f48 service nova] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Received unexpected event network-vif-plugged-4252cbc5-88bf-446c-abdb-46c174a0afa6 for instance with vm_state deleted and task_state None.
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:47:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:47:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:47:48 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:47:48 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7640MB free_disk=25.286888122558594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e45fbfcb-0107-4410-b5e1-71ba56995748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cbf6d0ec-b91d-4db5-b863-156754c746bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3b8cffe7-b0ad-487b-8229-54469afefdd2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances with incomplete migration  {{(pid=70914) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 13:47:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:47:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:51 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:51 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-73ff8326-77a3-43bf-8efa-98d5fcd17729 req-fd85df6a-91b4-4acc-954f-874a3efdbe48 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-changed-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-73ff8326-77a3-43bf-8efa-98d5fcd17729 req-fd85df6a-91b4-4acc-954f-874a3efdbe48 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Refreshing instance network info cache due to event network-changed-31f7f5f5-e982-4083-a3dd-48fd7e526cd5. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:47:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-73ff8326-77a3-43bf-8efa-98d5fcd17729 req-fd85df6a-91b4-4acc-954f-874a3efdbe48 service nova] Acquiring lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:47:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-73ff8326-77a3-43bf-8efa-98d5fcd17729 req-fd85df6a-91b4-4acc-954f-874a3efdbe48 service nova] Acquired lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:47:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-73ff8326-77a3-43bf-8efa-98d5fcd17729 req-fd85df6a-91b4-4acc-954f-874a3efdbe48 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Refreshing network info cache for port 31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:47:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:47:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:47:53 user nova-compute[70914]: DEBUG nova.network.neutron [req-73ff8326-77a3-43bf-8efa-98d5fcd17729 req-fd85df6a-91b4-4acc-954f-874a3efdbe48 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updated VIF entry in instance network info cache for port 31f7f5f5-e982-4083-a3dd-48fd7e526cd5. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:47:53 user nova-compute[70914]: DEBUG nova.network.neutron [req-73ff8326-77a3-43bf-8efa-98d5fcd17729 req-fd85df6a-91b4-4acc-954f-874a3efdbe48 service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updating instance_info_cache with network_info: [{"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:47:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-73ff8326-77a3-43bf-8efa-98d5fcd17729 req-fd85df6a-91b4-4acc-954f-874a3efdbe48 service nova] Releasing lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:47:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:47:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:47:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updating instance_info_cache with network_info: [{"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:47:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:47:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:47:53 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465659.0960164, d1f1d62d-885b-47b9-8d4d-972da97cba2f => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:47:54 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] VM Stopped (Lifecycle Event)
Jul 27 13:47:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7158288b-61b3-44d3-879b-d33ba890a65f None None] [instance: d1f1d62d-885b-47b9-8d4d-972da97cba2f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-27e1cb36-2716-43de-840b-34146b37f892 req-63b9ef3a-e86d-42ed-b408-84cc33be49a8 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-changed-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-27e1cb36-2716-43de-840b-34146b37f892 req-63b9ef3a-e86d-42ed-b408-84cc33be49a8 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Refreshing instance network info cache due to event network-changed-7987dffb-bb71-444e-b737-5c05b30e972b. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-27e1cb36-2716-43de-840b-34146b37f892 req-63b9ef3a-e86d-42ed-b408-84cc33be49a8 service nova] Acquiring lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-27e1cb36-2716-43de-840b-34146b37f892 req-63b9ef3a-e86d-42ed-b408-84cc33be49a8 service nova] Acquired lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG nova.network.neutron [req-27e1cb36-2716-43de-840b-34146b37f892 req-63b9ef3a-e86d-42ed-b408-84cc33be49a8 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Refreshing network info cache for port 7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Stashing vm_state: active {{(pid=70914) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'pci_requests' on Instance uuid 3b8cffe7-b0ad-487b-8229-54469afefdd2 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:47:54 user nova-compute[70914]: INFO nova.compute.claims [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Claim successful on node user
Jul 27 13:47:54 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'resources' on Instance uuid 3b8cffe7-b0ad-487b-8229-54469afefdd2 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:47:54 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b8cffe7-b0ad-487b-8229-54469afefdd2 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:47:55 user nova-compute[70914]: DEBUG nova.network.neutron [req-27e1cb36-2716-43de-840b-34146b37f892 req-63b9ef3a-e86d-42ed-b408-84cc33be49a8 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updated VIF entry in instance network info cache for port 7987dffb-bb71-444e-b737-5c05b30e972b. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:47:55 user nova-compute[70914]: DEBUG nova.network.neutron [req-27e1cb36-2716-43de-840b-34146b37f892 req-63b9ef3a-e86d-42ed-b408-84cc33be49a8 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updating instance_info_cache with network_info: [{"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:47:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-27e1cb36-2716-43de-840b-34146b37f892 req-63b9ef3a-e86d-42ed-b408-84cc33be49a8 service nova] Releasing lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:47:55 user nova-compute[70914]: INFO nova.compute.resource_tracker [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updating resource usage from migration 824a90a1-a26d-4656-91cb-2fdfc721f212
Jul 27 13:47:55 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:47:55 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:47:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.430s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:55 user nova-compute[70914]: INFO nova.compute.manager [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Migrating
Jul 27 13:47:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:47:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquired lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:47:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:47:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updating instance_info_cache with network_info: [{"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:47:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Releasing lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Starting migrate_disk_and_power_off {{(pid=70914) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-f076d776-ec52-438d-afdf-99cc4bfcfc21 req-7877be3e-ffa5-41eb-8c6f-892544103baf service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-vif-unplugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f076d776-ec52-438d-afdf-99cc4bfcfc21 req-7877be3e-ffa5-41eb-8c6f-892544103baf service nova] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f076d776-ec52-438d-afdf-99cc4bfcfc21 req-7877be3e-ffa5-41eb-8c6f-892544103baf service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f076d776-ec52-438d-afdf-99cc4bfcfc21 req-7877be3e-ffa5-41eb-8c6f-892544103baf service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-f076d776-ec52-438d-afdf-99cc4bfcfc21 req-7877be3e-ffa5-41eb-8c6f-892544103baf service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] No waiting events found dispatching network-vif-unplugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:47:56 user nova-compute[70914]: WARNING nova.compute.manager [req-f076d776-ec52-438d-afdf-99cc4bfcfc21 req-7877be3e-ffa5-41eb-8c6f-892544103baf service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received unexpected event network-vif-unplugged-7987dffb-bb71-444e-b737-5c05b30e972b for instance with vm_state active and task_state resize_migrating.
Jul 27 13:47:56 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Instance destroyed successfully.
Jul 27 13:47:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1759781246',display_name='tempest-ServerActionsTestOtherA-server-1759781246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1759781246',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-o61s0k8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=3b8cffe7-b0ad-487b-8229-54469afefdd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-947919029-network", "vif_mac": "fa:16:3e:f2:ce:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-947919029-network", "vif_mac": "fa:16:3e:f2:ce:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_vif [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7987dffb-bb, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:47:56 user nova-compute[70914]: INFO os_vif [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb')
Jul 27 13:47:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvDGkwep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:47:56 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[001e41d6-8b35-49fe-8908-9786b5658680]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:47:56 user nova-compute[70914]: No targets found.
Jul 27 13:47:56 user nova-compute[70914]: iSNS:
Jul 27 13:47:56 user nova-compute[70914]: No targets found.
Jul 27 13:47:56 user nova-compute[70914]: STATIC:
Jul 27 13:47:56 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97
Jul 27 13:47:56 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:47:56 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:47:56 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:47:56 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:47:56 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:47:56 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3
Jul 27 13:47:56 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:47:56 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:47:56 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25
Jul 27 13:47:56 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:47:56 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:47:56 user nova-compute[70914]: FIRMWARE:
Jul 27 13:47:56 user nova-compute[70914]: No targets found.
Jul 27 13:47:56 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:47:56 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:47:56 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c64b6a-eb82-4c79-9ea7-bea347574b09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd5dbce-fea6-4508-84de-b17a494b383e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:47:56 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:47:56 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:47:56 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:47:56 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:47:56 user nova-compute[70914]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:47:56 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:47:56 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:47:56 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf87ecaf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3'): ({'sde'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Removing single pathed devices sde {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:56 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ae26f4-98da-4bb0-b794-74ce619d5b90]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[22142957-3bbd-4906-8b74-11a4e06e2f7b]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flushing IO for device /dev/sde {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d1c5f-6c36-489c-85c5-10d245185b5e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb90fe0-fb99-440a-b894-16171000d434]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_adb1a5cd', '/dev/disk/by-id/scsi-23963613533353932', '/dev/disk/by-id/scsi-1SCST_BIOadb1a5cd-9ca535926079ab08') {{(pid=82182) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[786591c2-8c00-439f-94eb-a5fa1e6e602d]: (4, None) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ca82e7-25a2-4d63-9682-409884e3aa31]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f31c5d0-7da3-4ffc-9d07-bf58d38d7788]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260]
Jul 27 13:47:57 user nova-compute[70914]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260] successful.
Jul 27 13:47:57 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[09acf942-36d2-4ba8-9ba9-f93364af322c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== disconnect_volume: return (351ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:47:57 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Port 7987dffb-bb71-444e-b737-5c05b30e972b binding to destination host user is already ACTIVE {{(pid=70914) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquired lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-73ea4606-14c7-4151-940c-1f2a32b50c54 req-53653f72-a497-440c-b209-396ee99f40ef service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-73ea4606-14c7-4151-940c-1f2a32b50c54 req-53653f72-a497-440c-b209-396ee99f40ef service nova] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-73ea4606-14c7-4151-940c-1f2a32b50c54 req-53653f72-a497-440c-b209-396ee99f40ef service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-73ea4606-14c7-4151-940c-1f2a32b50c54 req-53653f72-a497-440c-b209-396ee99f40ef service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:47:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-73ea4606-14c7-4151-940c-1f2a32b50c54 req-53653f72-a497-440c-b209-396ee99f40ef service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] No waiting events found dispatching network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:47:58 user nova-compute[70914]: WARNING nova.compute.manager [req-73ea4606-14c7-4151-940c-1f2a32b50c54 req-53653f72-a497-440c-b209-396ee99f40ef service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received unexpected event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b for instance with vm_state active and task_state resize_migrated.
Jul 27 13:47:59 user nova-compute[70914]: DEBUG nova.network.neutron [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updating instance_info_cache with network_info: [{"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Releasing lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG os_brick.utils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81dbce1-a94a-4b53-bb47-7d3df3b32440]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d21da6-acbb-41a5-8baa-7965d2c5da5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1705327a-96f5-4cb9-93bd-30011a0a59b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[da634170-ff38-4000-8d9d-41d373c1cdfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:47:59 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:47:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a39886f-86f5-4037-b350-94fcb9852b93]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG os_brick.utils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:47:59 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465664.7895205, 0371b280-fc39-4cbd-b496-ba78fea4e856 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:47:59 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] VM Stopped (Lifecycle Event)
Jul 27 13:47:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f2c756cf-2a56-40f9-bf27-023b2965ea80 None None] [instance: 0371b280-fc39-4cbd-b496-ba78fea4e856] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:48:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:05 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:48:05 user nova-compute[70914]: INFO nova.compute.claims [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Claim successful on node user
Jul 27 13:48:05 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Refreshing inventories for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 13:48:05 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Updating ProviderTree inventory for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 13:48:05 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 13:48:05 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Refreshing aggregate associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, aggregates: None {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 13:48:05 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Refreshing trait associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:48:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:48:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG nova.policy [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47ed7ab38fa444d7b552d698c1266b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9d39303ca241749d982641d2a80b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:48:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Creating image(s)
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "/opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "/opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "/opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk 1073741824" returned: 0 in 0.051s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:48:06 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Successfully created port: 4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Starting finish_migration {{(pid=70914) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Instance directory exists: not creating {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 13:48:07 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Creating image(s)
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Ensure instance console log exists: /opt/stack/data/nova/instances/3b8cffe7-b0ad-487b-8229-54469afefdd2/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Start _get_guest_xml network_info=[{"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-947919029-network", "vif_mac": "fa:16:3e:f2:ce:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '681d1f07-cbbf-43a4-ad9c-89b883d78bb5', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvDGkwep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3b8cffe7-b0ad-487b-8229-54469afefdd2', 'attached_at': '2023-07-27T13:48:07.000000', 'detached_at': '', 'volume_id': 'aafdbf40-2399-4ec2-8c9d-4504787a18f3', 'serial': 'aafdbf40-2399-4ec2-8c9d-4504787a18f3'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:48:07 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:48:07 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b8cffe7-b0ad-487b-8229-54469afefdd2 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Cannot resize image /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lazy-loading 'migration_context' on Instance uuid e57eb314-e8bc-42ce-b972-88dff36a0fef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Ensure instance console log exists: /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvDGkwep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:48:07 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:48:07 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:48:07 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff7b8a6-994c-44eb-b23e-dd9befbf295d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:48:07 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[95525b0d-3b69-408e-b33d-7380285080ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3] added
Jul 27 13:48:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da7c055-eb91-4901-97aa-3617cffa6142]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08b3326-e4ee-4d97-a8b5-4c7b3c7c78e2]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvDGkwep {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvDGkwep" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e682c8f1-0d68-4241-9841-f5f13424d90f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvDGkwep'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7176d2a3-9b96-4293-9fe5-d391bfffc493]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceb1c03-2827-4697-9ffe-808c1fb96344]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:48:07 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:48:07 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:48:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:48:07 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:48:07 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:48:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceaf87b-1102-4b3a-8755-0c68a3f13279]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260]
Jul 27 13:48:07 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260] successful.
Jul 27 13:48:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ed4782-7931-4c3c-af3c-c6bab0cd4266]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d124a1-8b5b-47cf-9854-2a51026164a4]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:48:07 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:48:07 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:48:07 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:48:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:48:07 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:48:07 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:48:07 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:48:07 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd0eb9d-1718-4e02-b60c-1e9c24d54494]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvDGkwep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Successfully updated port: 4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "refresh_cache-e57eb314-e8bc-42ce-b972-88dff36a0fef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquired lock "refresh_cache-e57eb314-e8bc-42ce-b972-88dff36a0fef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-d74011ca-6351-4b14-bbd0-df8c1b808c82 req-6d822c82-4f8c-427b-89a4-0ce0b8cd555b service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received event network-changed-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-d74011ca-6351-4b14-bbd0-df8c1b808c82 req-6d822c82-4f8c-427b-89a4-0ce0b8cd555b service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Refreshing instance network info cache due to event network-changed-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:48:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d74011ca-6351-4b14-bbd0-df8c1b808c82 req-6d822c82-4f8c-427b-89a4-0ce0b8cd555b service nova] Acquiring lock "refresh_cache-e57eb314-e8bc-42ce-b972-88dff36a0fef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Updating instance_info_cache with network_info: [{"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Releasing lock "refresh_cache-e57eb314-e8bc-42ce-b972-88dff36a0fef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Instance network_info: |[{"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d74011ca-6351-4b14-bbd0-df8c1b808c82 req-6d822c82-4f8c-427b-89a4-0ce0b8cd555b service nova] Acquired lock "refresh_cache-e57eb314-e8bc-42ce-b972-88dff36a0fef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.neutron [req-d74011ca-6351-4b14-bbd0-df8c1b808c82 req-6d822c82-4f8c-427b-89a4-0ce0b8cd555b service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Refreshing network info cache for port 4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Start _get_guest_xml network_info=[{"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:48:08 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:48:08 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-303978480',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-303978480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3039784',id=31,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/i2v2lJMrrneI+OeJ1OPL65VGyr16rzvbaq55qcp+BeT8d+fAHIpAop/uZZmXl1De/bRbl+QphwemASuMOAWXBRTmogS+JKGbtQ/CoAjgDc0UyAkLgiRXyUuOY0JI9yA==',key_name='tempest-keypair-992062845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c9d39303ca241749d982641d2a80b9c',ramdisk_id='',reservation_id='r-cljavh05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837299822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ed7ab38fa444d7b552d698c1266b4a',uuid=e57eb314-e8bc-42ce-b972-88dff36a0fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Converting VIF {"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:0f:19,bridge_name='br-int',has_traffic_filtering=True,id=4665ab9b-5f56-4c14-b20f-245d7e7c4a1f,network=Network(892bcd79-a67c-4384-8838-d791a24e8e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4665ab9b-5f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lazy-loading 'pci_devices' on Instance uuid e57eb314-e8bc-42ce-b972-88dff36a0fef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:48:08 user nova-compute[70914]:   <uuid>e57eb314-e8bc-42ce-b972-88dff36a0fef</uuid>
Jul 27 13:48:08 user nova-compute[70914]:   <name>instance-0000001f</name>
Jul 27 13:48:08 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:48:08 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:48:08 user nova-compute[70914]:   <metadata>
Jul 27 13:48:08 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:48:08 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-303978480</nova:name>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:48:08</nova:creationTime>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:48:08 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:48:08 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:owner>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:user uuid="47ed7ab38fa444d7b552d698c1266b4a">tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member</nova:user>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:project uuid="9c9d39303ca241749d982641d2a80b9c">tempest-TestServerVolumeAttachScenarioOldVersion-1837299822</nova:project>
Jul 27 13:48:08 user nova-compute[70914]:       </nova:owner>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:ports>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:port uuid="4665ab9b-5f56-4c14-b20f-245d7e7c4a1f">
Jul 27 13:48:08 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 13:48:08 user nova-compute[70914]:         </nova:port>
Jul 27 13:48:08 user nova-compute[70914]:       </nova:ports>
Jul 27 13:48:08 user nova-compute[70914]:     </nova:instance>
Jul 27 13:48:08 user nova-compute[70914]:   </metadata>
Jul 27 13:48:08 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:48:08 user nova-compute[70914]:     <system>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="serial">e57eb314-e8bc-42ce-b972-88dff36a0fef</entry>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="uuid">e57eb314-e8bc-42ce-b972-88dff36a0fef</entry>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:48:08 user nova-compute[70914]:     </system>
Jul 27 13:48:08 user nova-compute[70914]:   </sysinfo>
Jul 27 13:48:08 user nova-compute[70914]:   <os>
Jul 27 13:48:08 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:48:08 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:48:08 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:48:08 user nova-compute[70914]:   </os>
Jul 27 13:48:08 user nova-compute[70914]:   <features>
Jul 27 13:48:08 user nova-compute[70914]:     <acpi/>
Jul 27 13:48:08 user nova-compute[70914]:     <apic/>
Jul 27 13:48:08 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:48:08 user nova-compute[70914]:   </features>
Jul 27 13:48:08 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:48:08 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:48:08 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:48:08 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:48:08 user nova-compute[70914]:   </clock>
Jul 27 13:48:08 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:48:08 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:48:08 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:48:08 user nova-compute[70914]:   </cpu>
Jul 27 13:48:08 user nova-compute[70914]:   <devices>
Jul 27 13:48:08 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:48:08 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:48:08 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk"/>
Jul 27 13:48:08 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:48:08 user nova-compute[70914]:     </disk>
Jul 27 13:48:08 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:48:08 user nova-compute[70914]:       <mac address="fa:16:3e:14:0f:19"/>
Jul 27 13:48:08 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:48:08 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:48:08 user nova-compute[70914]:       <target dev="tap4665ab9b-5f"/>
Jul 27 13:48:08 user nova-compute[70914]:     </interface>
Jul 27 13:48:08 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:48:08 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/console.log" append="off"/>
Jul 27 13:48:08 user nova-compute[70914]:     </serial>
Jul 27 13:48:08 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:48:08 user nova-compute[70914]:     <video>
Jul 27 13:48:08 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:48:08 user nova-compute[70914]:     </video>
Jul 27 13:48:08 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:48:08 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:48:08 user nova-compute[70914]:     </rng>
Jul 27 13:48:08 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:48:08 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:48:08 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:48:08 user nova-compute[70914]:     </memballoon>
Jul 27 13:48:08 user nova-compute[70914]:   </devices>
Jul 27 13:48:08 user nova-compute[70914]: </domain>
Jul 27 13:48:08 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-303978480',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-303978480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3039784',id=31,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/i2v2lJMrrneI+OeJ1OPL65VGyr16rzvbaq55qcp+BeT8d+fAHIpAop/uZZmXl1De/bRbl+QphwemASuMOAWXBRTmogS+JKGbtQ/CoAjgDc0UyAkLgiRXyUuOY0JI9yA==',key_name='tempest-keypair-992062845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c9d39303ca241749d982641d2a80b9c',ramdisk_id='',reservation_id='r-cljavh05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837299822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ed7ab38fa444d7b552d698c1266b4a',uuid=e57eb314-e8bc-42ce-b972-88dff36a0fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Converting VIF {"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:0f:19,bridge_name='br-int',has_traffic_filtering=True,id=4665ab9b-5f56-4c14-b20f-245d7e7c4a1f,network=Network(892bcd79-a67c-4384-8838-d791a24e8e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4665ab9b-5f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG os_vif [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:0f:19,bridge_name='br-int',has_traffic_filtering=True,id=4665ab9b-5f56-4c14-b20f-245d7e7c4a1f,network=Network(892bcd79-a67c-4384-8838-d791a24e8e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4665ab9b-5f') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4665ab9b-5f, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4665ab9b-5f, col_values=(('external_ids', {'iface-id': '4665ab9b-5f56-4c14-b20f-245d7e7c4a1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:0f:19', 'vm-uuid': 'e57eb314-e8bc-42ce-b972-88dff36a0fef'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:08 user nova-compute[70914]: INFO os_vif [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:0f:19,bridge_name='br-int',has_traffic_filtering=True,id=4665ab9b-5f56-4c14-b20f-245d7e7c4a1f,network=Network(892bcd79-a67c-4384-8838-d791a24e8e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4665ab9b-5f')
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] No VIF found with MAC fa:16:3e:14:0f:19, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23963613533353932', 'path': '/dev/sdd'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963613533353932', 'path': '/dev/sdd'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1759781246',display_name='tempest-ServerActionsTestOtherA-server-1759781246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1759781246',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-o61s0k8m',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=3b8cffe7-b0ad-487b-8229-54469afefdd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-947919029-network", "vif_mac": "fa:16:3e:f2:ce:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-947919029-network", "vif_mac": "fa:16:3e:f2:ce:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:48:08 user nova-compute[70914]:   <uuid>3b8cffe7-b0ad-487b-8229-54469afefdd2</uuid>
Jul 27 13:48:08 user nova-compute[70914]:   <name>instance-0000001e</name>
Jul 27 13:48:08 user nova-compute[70914]:   <memory>2097152</memory>
Jul 27 13:48:08 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:48:08 user nova-compute[70914]:   <metadata>
Jul 27 13:48:08 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:48:08 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:name>tempest-ServerActionsTestOtherA-server-1759781246</nova:name>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:48:07</nova:creationTime>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:flavor name="m1.small">
Jul 27 13:48:08 user nova-compute[70914]:         <nova:memory>2048</nova:memory>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:disk>20</nova:disk>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:48:08 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:owner>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:user uuid="252ad07dbf034a09b3be3c05dba67b3f">tempest-ServerActionsTestOtherA-1561010505-project-member</nova:user>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:project uuid="5da684ade5ad4a328eb543f6d6da0ad9">tempest-ServerActionsTestOtherA-1561010505</nova:project>
Jul 27 13:48:08 user nova-compute[70914]:       </nova:owner>
Jul 27 13:48:08 user nova-compute[70914]:       <nova:ports>
Jul 27 13:48:08 user nova-compute[70914]:         <nova:port uuid="7987dffb-bb71-444e-b737-5c05b30e972b">
Jul 27 13:48:08 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 13:48:08 user nova-compute[70914]:         </nova:port>
Jul 27 13:48:08 user nova-compute[70914]:       </nova:ports>
Jul 27 13:48:08 user nova-compute[70914]:     </nova:instance>
Jul 27 13:48:08 user nova-compute[70914]:   </metadata>
Jul 27 13:48:08 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:48:08 user nova-compute[70914]:     <system>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="serial">3b8cffe7-b0ad-487b-8229-54469afefdd2</entry>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="uuid">3b8cffe7-b0ad-487b-8229-54469afefdd2</entry>
Jul 27 13:48:08 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:48:08 user nova-compute[70914]:     </system>
Jul 27 13:48:08 user nova-compute[70914]:   </sysinfo>
Jul 27 13:48:08 user nova-compute[70914]:   <os>
Jul 27 13:48:08 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:48:08 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:48:08 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:48:08 user nova-compute[70914]:   </os>
Jul 27 13:48:08 user nova-compute[70914]:   <features>
Jul 27 13:48:08 user nova-compute[70914]:     <acpi/>
Jul 27 13:48:08 user nova-compute[70914]:     <apic/>
Jul 27 13:48:08 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:48:08 user nova-compute[70914]:   </features>
Jul 27 13:48:08 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:48:08 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:48:08 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:48:08 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:48:08 user nova-compute[70914]:   </clock>
Jul 27 13:48:08 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:48:08 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:48:08 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:48:08 user nova-compute[70914]:   </cpu>
Jul 27 13:48:08 user nova-compute[70914]:   <devices>
Jul 27 13:48:08 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:48:08 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:48:08 user nova-compute[70914]:       <source dev="/dev/sdd"/>
Jul 27 13:48:08 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:48:08 user nova-compute[70914]:       <serial>aafdbf40-2399-4ec2-8c9d-4504787a18f3</serial>
Jul 27 13:48:08 user nova-compute[70914]:     </disk>
Jul 27 13:48:08 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:48:08 user nova-compute[70914]:       <mac address="fa:16:3e:f2:ce:a9"/>
Jul 27 13:48:08 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:48:08 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:48:08 user nova-compute[70914]:       <target dev="tap7987dffb-bb"/>
Jul 27 13:48:08 user nova-compute[70914]:     </interface>
Jul 27 13:48:08 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:48:08 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/3b8cffe7-b0ad-487b-8229-54469afefdd2/console.log" append="off"/>
Jul 27 13:48:08 user nova-compute[70914]:     </serial>
Jul 27 13:48:08 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:48:08 user nova-compute[70914]:     <video>
Jul 27 13:48:08 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:48:08 user nova-compute[70914]:     </video>
Jul 27 13:48:08 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:48:08 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:48:08 user nova-compute[70914]:     </rng>
Jul 27 13:48:08 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:48:08 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:48:08 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:48:08 user nova-compute[70914]:     </memballoon>
Jul 27 13:48:08 user nova-compute[70914]:   </devices>
Jul 27 13:48:08 user nova-compute[70914]: </domain>
Jul 27 13:48:08 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1759781246',display_name='tempest-ServerActionsTestOtherA-server-1759781246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1759781246',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-o61s0k8m',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=3b8cffe7-b0ad-487b-8229-54469afefdd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-947919029-network", "vif_mac": "fa:16:3e:f2:ce:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-947919029-network", "vif_mac": "fa:16:3e:f2:ce:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG os_vif [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7987dffb-bb, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7987dffb-bb, col_values=(('external_ids', {'iface-id': '7987dffb-bb71-444e-b737-5c05b30e972b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:ce:a9', 'vm-uuid': '3b8cffe7-b0ad-487b-8229-54469afefdd2'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:08 user nova-compute[70914]: INFO os_vif [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb')
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.neutron [req-d74011ca-6351-4b14-bbd0-df8c1b808c82 req-6d822c82-4f8c-427b-89a4-0ce0b8cd555b service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Updated VIF entry in instance network info cache for port 4665ab9b-5f56-4c14-b20f-245d7e7c4a1f. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.network.neutron [req-d74011ca-6351-4b14-bbd0-df8c1b808c82 req-6d822c82-4f8c-427b-89a4-0ce0b8cd555b service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Updating instance_info_cache with network_info: [{"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] No VIF found with MAC fa:16:3e:f2:ce:a9, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d74011ca-6351-4b14-bbd0-df8c1b808c82 req-6d822c82-4f8c-427b-89a4-0ce0b8cd555b service nova] Releasing lock "refresh_cache-e57eb314-e8bc-42ce-b972-88dff36a0fef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:08 user nova-compute[70914]: INFO nova.compute.manager [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Detaching volume 6f2203aa-baa2-4a45-8081-82734d7bdd97
Jul 27 13:48:09 user nova-compute[70914]: INFO nova.virt.block_device [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Attempting to driver detach volume 6f2203aa-baa2-4a45-8081-82734d7bdd97 from mountpoint /dev/vdc
Jul 27 13:48:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Attempting to detach device vdc from instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:48:09 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:48:09 user nova-compute[70914]:   <source dev="/dev/sdf"/>
Jul 27 13:48:09 user nova-compute[70914]:   <target dev="vdc" bus="virtio"/>
Jul 27 13:48:09 user nova-compute[70914]:   <serial>6f2203aa-baa2-4a45-8081-82734d7bdd97</serial>
Jul 27 13:48:09 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 13:48:09 user nova-compute[70914]: </disk>
Jul 27 13:48:09 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:48:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Successfully detached device vdc from instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc from the persistent domain config.
Jul 27 13:48:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:48:09 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:48:09 user nova-compute[70914]:   <source dev="/dev/sdf"/>
Jul 27 13:48:09 user nova-compute[70914]:   <target dev="vdc" bus="virtio"/>
Jul 27 13:48:09 user nova-compute[70914]:   <serial>6f2203aa-baa2-4a45-8081-82734d7bdd97</serial>
Jul 27 13:48:09 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 13:48:09 user nova-compute[70914]: </disk>
Jul 27 13:48:09 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465689.563537, 4e856bc3-ce45-4307-af2b-33c82ed1eccc => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:48:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Successfully detached device vdc from instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc from the live domain config.
Jul 27 13:48:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZRaUkpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:48:09 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81e030c-6173-4ebc-b561-6a173fe8f9a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:48:09 user nova-compute[70914]: No targets found.
Jul 27 13:48:09 user nova-compute[70914]: iSNS:
Jul 27 13:48:09 user nova-compute[70914]: No targets found.
Jul 27 13:48:09 user nova-compute[70914]: STATIC:
Jul 27 13:48:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97
Jul 27 13:48:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:48:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:48:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:48:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:48:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:48:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3
Jul 27 13:48:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:48:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:48:09 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25
Jul 27 13:48:09 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:48:09 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:48:09 user nova-compute[70914]: FIRMWARE:
Jul 27 13:48:09 user nova-compute[70914]: No targets found.
Jul 27 13:48:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:48:09 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:48:09 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e285ce-db04-4355-85d9-e59946333880]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad7b0a3-50b0-4c54-9b7e-600af5ae4d3e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:48:09 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:48:09 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:48:09 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:48:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:48:09 user nova-compute[70914]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 (non-flash)
Jul 27 13:48:09 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:48:09 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:48:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c187b7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97'): ({'sdf'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Removing single pathed devices sdf {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7099b131-1fd4-4dfe-8fdc-83765f1d850b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b597f7d3-6765-409a-a002-d0a120955815]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Flushing IO for device /dev/sdf {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7e076c-3b3e-4518-bc26-4771ab482ce0]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd99e46-f361-4b40-a96a-74cbcf0e2dba]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] SCSI volumes sdf have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[201793ec-cc18-4cc7-aa32-0c390efe790e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb504b5-7367-4dd8-a105-d40a52a1e063]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97, portal: 172.16.0.220,3260]
Jul 27 13:48:09 user nova-compute[70914]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97, portal: 172.16.0.220,3260] successful.
Jul 27 13:48:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2203aa-baa2-4a45-8081-82734d7bdd97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef45987-b88f-4ddf-8f04-088da77ca078]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] <== disconnect_volume: return (322ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:48:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:48:10 user nova-compute[70914]: DEBUG nova.objects.instance [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'flavor' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-06d942f6-fa97-4ad2-9ea9-645cce096ff5 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-8dad30bf-e89c-42a5-99bc-2d0206b12e28 req-ed3689c6-8faf-403f-8bb8-d39ce574e910 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8dad30bf-e89c-42a5-99bc-2d0206b12e28 req-ed3689c6-8faf-403f-8bb8-d39ce574e910 service nova] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8dad30bf-e89c-42a5-99bc-2d0206b12e28 req-ed3689c6-8faf-403f-8bb8-d39ce574e910 service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8dad30bf-e89c-42a5-99bc-2d0206b12e28 req-ed3689c6-8faf-403f-8bb8-d39ce574e910 service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-8dad30bf-e89c-42a5-99bc-2d0206b12e28 req-ed3689c6-8faf-403f-8bb8-d39ce574e910 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] No waiting events found dispatching network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:11 user nova-compute[70914]: WARNING nova.compute.manager [req-8dad30bf-e89c-42a5-99bc-2d0206b12e28 req-ed3689c6-8faf-403f-8bb8-d39ce574e910 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received unexpected event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b for instance with vm_state active and task_state resize_finish.
Jul 27 13:48:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-ae8d1b1d-5f96-41d8-8422-566f16fa8a32 req-efd877a6-6cfb-46d7-90c3-4e5770712d50 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received event network-vif-plugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ae8d1b1d-5f96-41d8-8422-566f16fa8a32 req-efd877a6-6cfb-46d7-90c3-4e5770712d50 service nova] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ae8d1b1d-5f96-41d8-8422-566f16fa8a32 req-efd877a6-6cfb-46d7-90c3-4e5770712d50 service nova] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ae8d1b1d-5f96-41d8-8422-566f16fa8a32 req-efd877a6-6cfb-46d7-90c3-4e5770712d50 service nova] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-ae8d1b1d-5f96-41d8-8422-566f16fa8a32 req-efd877a6-6cfb-46d7-90c3-4e5770712d50 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] No waiting events found dispatching network-vif-plugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:11 user nova-compute[70914]: WARNING nova.compute.manager [req-ae8d1b1d-5f96-41d8-8422-566f16fa8a32 req-efd877a6-6cfb-46d7-90c3-4e5770712d50 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received unexpected event network-vif-plugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f for instance with vm_state building and task_state spawning.
Jul 27 13:48:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:11 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465676.8232603, 3b8cffe7-b0ad-487b-8229-54469afefdd2 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:11 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] VM Stopped (Lifecycle Event)
Jul 27 13:48:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3db5d44d-2696-4ace-8ad9-87ecc3198b8d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ba17c44-28ef-4003-a3bb-e855d3cbdbad req-6d69ad71-1de8-467d-b2b2-38bd6c443c52 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ba17c44-28ef-4003-a3bb-e855d3cbdbad req-6d69ad71-1de8-467d-b2b2-38bd6c443c52 service nova] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ba17c44-28ef-4003-a3bb-e855d3cbdbad req-6d69ad71-1de8-467d-b2b2-38bd6c443c52 service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ba17c44-28ef-4003-a3bb-e855d3cbdbad req-6d69ad71-1de8-467d-b2b2-38bd6c443c52 service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ba17c44-28ef-4003-a3bb-e855d3cbdbad req-6d69ad71-1de8-467d-b2b2-38bd6c443c52 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] No waiting events found dispatching network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:13 user nova-compute[70914]: WARNING nova.compute.manager [req-8ba17c44-28ef-4003-a3bb-e855d3cbdbad req-6d69ad71-1de8-467d-b2b2-38bd6c443c52 service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received unexpected event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b for instance with vm_state active and task_state resize_finish.
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-9f9a1a9e-0ac4-45f0-94b4-a1ae2b7dfbe8 req-b0716391-2fb8-4ab7-ae6e-ff5ce4f2232c service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received event network-vif-plugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9f9a1a9e-0ac4-45f0-94b4-a1ae2b7dfbe8 req-b0716391-2fb8-4ab7-ae6e-ff5ce4f2232c service nova] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9f9a1a9e-0ac4-45f0-94b4-a1ae2b7dfbe8 req-b0716391-2fb8-4ab7-ae6e-ff5ce4f2232c service nova] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9f9a1a9e-0ac4-45f0-94b4-a1ae2b7dfbe8 req-b0716391-2fb8-4ab7-ae6e-ff5ce4f2232c service nova] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [req-9f9a1a9e-0ac4-45f0-94b4-a1ae2b7dfbe8 req-b0716391-2fb8-4ab7-ae6e-ff5ce4f2232c service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] No waiting events found dispatching network-vif-plugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:13 user nova-compute[70914]: WARNING nova.compute.manager [req-9f9a1a9e-0ac4-45f0-94b4-a1ae2b7dfbe8 req-b0716391-2fb8-4ab7-ae6e-ff5ce4f2232c service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received unexpected event network-vif-plugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f for instance with vm_state building and task_state spawning.
Jul 27 13:48:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465693.5520675, 3b8cffe7-b0ad-487b-8229-54469afefdd2 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] VM Resumed (Lifecycle Event)
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Instance running successfully.
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Failed to set time: agent not configured {{(pid=70914) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7c87897c-4fe4-4caa-a163-7d3a6c64044d tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] finish_migration finished successfully. {{(pid=70914) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Instance spawned successfully.
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465693.5570378, 3b8cffe7-b0ad-487b-8229-54469afefdd2 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] VM Started (Lifecycle Event)
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465693.5635624, e57eb314-e8bc-42ce-b972-88dff36a0fef => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] VM Resumed (Lifecycle Event)
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.compute.manager [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Took 7.33 seconds to spawn the instance on the hypervisor.
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465693.56712, e57eb314-e8bc-42ce-b972-88dff36a0fef => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] VM Started (Lifecycle Event)
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:48:13 user nova-compute[70914]: INFO nova.compute.manager [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Took 8.62 seconds to build instance.
Jul 27 13:48:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f5dea4bd-1ba4-4407-8ab4-809ee0a5213d tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.725s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:16 user nova-compute[70914]: INFO nova.compute.manager [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Detaching volume f361b3d4-e058-4a11-b17e-b76cd0060c25
Jul 27 13:48:16 user nova-compute[70914]: INFO nova.virt.block_device [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Attempting to driver detach volume f361b3d4-e058-4a11-b17e-b76cd0060c25 from mountpoint /dev/vdb
Jul 27 13:48:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Attempting to detach device vdb from instance cbf6d0ec-b91d-4db5-b863-156754c746bc from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:48:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:48:16 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:48:16 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:48:16 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:48:16 user nova-compute[70914]:   <serial>f361b3d4-e058-4a11-b17e-b76cd0060c25</serial>
Jul 27 13:48:16 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:48:16 user nova-compute[70914]: </disk>
Jul 27 13:48:16 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:48:16 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Successfully detached device vdb from instance cbf6d0ec-b91d-4db5-b863-156754c746bc from the persistent domain config.
Jul 27 13:48:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cbf6d0ec-b91d-4db5-b863-156754c746bc from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:48:16 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:48:16 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:48:16 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:48:16 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:48:16 user nova-compute[70914]:   <serial>f361b3d4-e058-4a11-b17e-b76cd0060c25</serial>
Jul 27 13:48:16 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:48:16 user nova-compute[70914]: </disk>
Jul 27 13:48:16 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465697.0129642, cbf6d0ec-b91d-4db5-b863-156754c746bc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cbf6d0ec-b91d-4db5-b863-156754c746bc {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:48:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Successfully detached device vdb from instance cbf6d0ec-b91d-4db5-b863-156754c746bc from the live domain config.
Jul 27 13:48:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtAFsLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:48:17 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ff63eb-2d1a-46df-89ec-3dade50e9707]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:48:17 user nova-compute[70914]: No targets found.
Jul 27 13:48:17 user nova-compute[70914]: iSNS:
Jul 27 13:48:17 user nova-compute[70914]: No targets found.
Jul 27 13:48:17 user nova-compute[70914]: STATIC:
Jul 27 13:48:17 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:48:17 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:48:17 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:48:17 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3
Jul 27 13:48:17 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:48:17 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:48:17 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25
Jul 27 13:48:17 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:48:17 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:48:17 user nova-compute[70914]: FIRMWARE:
Jul 27 13:48:17 user nova-compute[70914]: No targets found.
Jul 27 13:48:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:48:17 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:48:17 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae705f01-56e8-4a6d-8a5d-064449c99d3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7dd13a-06ff-4d7d-8b48-f033bfbb6d8b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:48:17 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:48:17 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:48:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:48:17 user nova-compute[70914]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 (non-flash)
Jul 27 13:48:17 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:48:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c186036d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbac0cdd-961d-4210-b6d3-024c5c76c805]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1175ec10-ca74-4b54-b275-47e54be654b4]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[698ecf9f-35f2-4605-acd6-d9eb44ecdbda]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b496a12a-6c12-4e6b-a60d-e38f45a0653d]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[499338b9-320d-4321-a0de-25b33fbce428]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a24a9c-d93e-4c9c-bc22-9c7b4a82ba79]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25, portal: 172.16.0.220,3260]
Jul 27 13:48:17 user nova-compute[70914]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25, portal: 172.16.0.220,3260] successful.
Jul 27 13:48:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d6f0e4-c424-47fa-9b2a-77a12afc0a34]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] <== disconnect_volume: return (305ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:48:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'flavor' on Instance uuid cbf6d0ec-b91d-4db5-b863-156754c746bc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d17e728b-171b-4c97-b7da-75cfb209dc7b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.584s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:18 user nova-compute[70914]: INFO nova.compute.manager [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Terminating instance
Jul 27 13:48:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-cba216f5-9b00-45c4-89b2-ff047e4d81d7 req-15f96f76-4cee-4c5d-b627-a2899e061bd9 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-vif-unplugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cba216f5-9b00-45c4-89b2-ff047e4d81d7 req-15f96f76-4cee-4c5d-b627-a2899e061bd9 service nova] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cba216f5-9b00-45c4-89b2-ff047e4d81d7 req-15f96f76-4cee-4c5d-b627-a2899e061bd9 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cba216f5-9b00-45c4-89b2-ff047e4d81d7 req-15f96f76-4cee-4c5d-b627-a2899e061bd9 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-cba216f5-9b00-45c4-89b2-ff047e4d81d7 req-15f96f76-4cee-4c5d-b627-a2899e061bd9 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] No waiting events found dispatching network-vif-unplugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-cba216f5-9b00-45c4-89b2-ff047e4d81d7 req-15f96f76-4cee-4c5d-b627-a2899e061bd9 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-vif-unplugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:18 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Instance destroyed successfully.
Jul 27 13:48:18 user nova-compute[70914]: DEBUG nova.objects.instance [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'resources' on Instance uuid cbf6d0ec-b91d-4db5-b863-156754c746bc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:45:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-644580012',display_name='tempest-VolumesSnapshotTestJSON-instance-644580012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-644580012',id=28,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNo5qJ+pKdNd63nJVYeexr/7s1uP5MLIjHcEEWV2oJMtLv1STTdDkX6Gk+GokxTCJMgMxGOdeMvGqfxPHBZ3/6TT85zUVqSVp95uGcMOGbOJ4QATR0nyyvrqXd2EXIE5Q==',key_name='tempest-keypair-1404813722',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:45:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82c2842f73314df7b38893d27acf46e0',ramdisk_id='',reservation_id='r-0kdmaqnf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-277407372',owner_user_name='tempest-VolumesSnapshotTestJSON-277407372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0d5277a420b42bfb40dfc0196fea575',uuid=cbf6d0ec-b91d-4db5-b863-156754c746bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converting VIF {"id": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "address": "fa:16:3e:36:7d:4f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ae2dfc-c7", "ovs_interfaceid": "c1ae2dfc-c734-4be9-bdd3-568940fbeb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:7d:4f,bridge_name='br-int',has_traffic_filtering=True,id=c1ae2dfc-c734-4be9-bdd3-568940fbeb0a,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ae2dfc-c7') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG os_vif [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:7d:4f,bridge_name='br-int',has_traffic_filtering=True,id=c1ae2dfc-c734-4be9-bdd3-568940fbeb0a,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ae2dfc-c7') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1ae2dfc-c7, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:48:18 user nova-compute[70914]: INFO os_vif [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:7d:4f,bridge_name='br-int',has_traffic_filtering=True,id=c1ae2dfc-c734-4be9-bdd3-568940fbeb0a,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ae2dfc-c7')
Jul 27 13:48:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtAFsLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:48:18 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:48:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad664b6-3a49-41c8-ab7d-407a269333aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:48:19 user nova-compute[70914]: No targets found.
Jul 27 13:48:19 user nova-compute[70914]: iSNS:
Jul 27 13:48:19 user nova-compute[70914]: No targets found.
Jul 27 13:48:19 user nova-compute[70914]: STATIC:
Jul 27 13:48:19 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:48:19 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:48:19 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:48:19 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3
Jul 27 13:48:19 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:48:19 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:48:19 user nova-compute[70914]: FIRMWARE:
Jul 27 13:48:19 user nova-compute[70914]: No targets found.
Jul 27 13:48:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:48:19 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:48:19 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f361b3d4-e058-4a11-b17e-b76cd0060c25', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a2adde-5e9d-4f18-b17c-65f011c99244]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7c0138-43a0-44e8-95b9-7f95ee21d74b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:48:19 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:48:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:48:19 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:48:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c381a9360>, {}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Disconnecting from: [] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.115s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] <== disconnect_volume: return (116ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:48:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Deleting instance files /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc_del
Jul 27 13:48:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Deletion of /opt/stack/data/nova/instances/cbf6d0ec-b91d-4db5-b863-156754c746bc_del complete
Jul 27 13:48:19 user nova-compute[70914]: INFO nova.compute.manager [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 27 13:48:19 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] No waiting events found dispatching network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:20 user nova-compute[70914]: WARNING nova.compute.manager [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received unexpected event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a for instance with vm_state active and task_state deleting.
Jul 27 13:48:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] No waiting events found dispatching network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:20 user nova-compute[70914]: WARNING nova.compute.manager [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received unexpected event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a for instance with vm_state active and task_state deleting.
Jul 27 13:48:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] No waiting events found dispatching network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:20 user nova-compute[70914]: WARNING nova.compute.manager [req-8ae416f2-3fbe-4109-929a-7daaa3c897a7 req-5b8e0e52-3356-4d37-9f93-67f6ea6da038 service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received unexpected event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a for instance with vm_state active and task_state deleting.
Jul 27 13:48:21 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:48:21 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Took 2.14 seconds to deallocate network for instance.
Jul 27 13:48:21 user nova-compute[70914]: WARNING nova.volume.cinder [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Attachment 60d77391-5845-421a-8d74-5ecfdf52db74 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 60d77391-5845-421a-8d74-5ecfdf52db74. (HTTP 404) (Request-ID: req-70ef9904-15df-4fcf-8cfd-a609be1c4c21)
Jul 27 13:48:21 user nova-compute[70914]: INFO nova.compute.manager [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Took 0.08 seconds to detach 1 volumes for instance.
Jul 27 13:48:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.007s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:21 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:48:21 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:48:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:21 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Deleted allocations for instance cbf6d0ec-b91d-4db5-b863-156754c746bc
Jul 27 13:48:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-79e88555-0d46-4b30-93ad-f35a1705486b tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.888s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-vif-unplugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] No waiting events found dispatching network-vif-unplugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:22 user nova-compute[70914]: WARNING nova.compute.manager [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received unexpected event network-vif-unplugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a for instance with vm_state deleted and task_state None.
Jul 27 13:48:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] Acquiring lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] Lock "cbf6d0ec-b91d-4db5-b863-156754c746bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] No waiting events found dispatching network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:22 user nova-compute[70914]: WARNING nova.compute.manager [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received unexpected event network-vif-plugged-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a for instance with vm_state deleted and task_state None.
Jul 27 13:48:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-991293e9-db92-4ad0-b8ae-3cb47e23ae94 req-f9c37b69-6e98-496e-b03d-fe5bae82ff6e service nova] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Received event network-vif-deleted-c1ae2dfc-c734-4be9-bdd3-568940fbeb0a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:31 user nova-compute[70914]: INFO nova.compute.manager [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Terminating instance
Jul 27 13:48:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:48:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-2496ae73-29ea-4ad8-ac31-d66891eb4529 req-56a40c37-f78b-4833-b231-bbf0b8f68622 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-unplugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2496ae73-29ea-4ad8-ac31-d66891eb4529 req-56a40c37-f78b-4833-b231-bbf0b8f68622 service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2496ae73-29ea-4ad8-ac31-d66891eb4529 req-56a40c37-f78b-4833-b231-bbf0b8f68622 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2496ae73-29ea-4ad8-ac31-d66891eb4529 req-56a40c37-f78b-4833-b231-bbf0b8f68622 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-2496ae73-29ea-4ad8-ac31-d66891eb4529 req-56a40c37-f78b-4833-b231-bbf0b8f68622 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-unplugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-2496ae73-29ea-4ad8-ac31-d66891eb4529 req-56a40c37-f78b-4833-b231-bbf0b8f68622 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-unplugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:32 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Instance destroyed successfully.
Jul 27 13:48:32 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'resources' on Instance uuid e45fbfcb-0107-4410-b5e1-71ba56995748 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-851597049',display_name='tempest-ServerRescueNegativeTestJSON-server-851597049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-851597049',id=2,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:34:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-oj84tw8y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:34:12Z,user_data=None,user_id='a0d92b0b34814e75a7709e09e357be07',uuid=e45fbfcb-0107-4410-b5e1-71ba56995748,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "c29c2d71-8315-41b0-9029-d9cd7803d316", "address": "fa:16:3e:0c:c5:fe", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29c2d71-83", "ovs_interfaceid": "c29c2d71-8315-41b0-9029-d9cd7803d316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=c29c2d71-8315-41b0-9029-d9cd7803d316,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29c2d71-83') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG os_vif [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=c29c2d71-8315-41b0-9029-d9cd7803d316,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29c2d71-83') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc29c2d71-83, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:48:32 user nova-compute[70914]: INFO os_vif [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=c29c2d71-8315-41b0-9029-d9cd7803d316,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29c2d71-83')
Jul 27 13:48:32 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Deleting instance files /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748_del
Jul 27 13:48:32 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Deletion of /opt/stack/data/nova/instances/e45fbfcb-0107-4410-b5e1-71ba56995748_del complete
Jul 27 13:48:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:32 user nova-compute[70914]: INFO nova.compute.manager [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 27 13:48:32 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:48:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:33 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:48:33 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Took 0.89 seconds to deallocate network for instance.
Jul 27 13:48:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:33 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465698.9008877, cbf6d0ec-b91d-4db5-b863-156754c746bc => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:33 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] VM Stopped (Lifecycle Event)
Jul 27 13:48:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-74ee93d3-20d2-4e92-bd22-76d952147cab None None] [instance: cbf6d0ec-b91d-4db5-b863-156754c746bc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:33 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:48:33 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:48:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:34 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Deleted allocations for instance e45fbfcb-0107-4410-b5e1-71ba56995748
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f82a7361-9317-4493-9ae4-9977a6096f3d tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:34 user nova-compute[70914]: WARNING nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received unexpected event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with vm_state deleted and task_state None.
Jul 27 13:48:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:34 user nova-compute[70914]: WARNING nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received unexpected event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with vm_state deleted and task_state None.
Jul 27 13:48:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:34 user nova-compute[70914]: WARNING nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received unexpected event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with vm_state deleted and task_state None.
Jul 27 13:48:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Acquiring lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] Lock "e45fbfcb-0107-4410-b5e1-71ba56995748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] No waiting events found dispatching network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:34 user nova-compute[70914]: WARNING nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received unexpected event network-vif-plugged-c29c2d71-8315-41b0-9029-d9cd7803d316 for instance with vm_state deleted and task_state None.
Jul 27 13:48:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-6405ba2b-1cd8-46b3-bf56-a02d29e06dca req-6488c6f3-a853-4dbf-997f-4267a425a403 service nova] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Received event network-vif-deleted-c29c2d71-8315-41b0-9029-d9cd7803d316 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:37 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_power_states {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 3b8cffe7-b0ad-487b-8229-54469afefdd2 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid e57eb314-e8bc-42ce-b972-88dff36a0fef {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "1b676522-c547-497a-9b3b-8436f85c7f40" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "1b676522-c547-497a-9b3b-8436f85c7f40" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:38 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:48:38 user nova-compute[70914]: INFO nova.compute.claims [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Claim successful on node user
Jul 27 13:48:39 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG nova.network.neutron [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:48:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:48:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG nova.policy [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '340b2ab1e12b4e0491b86f3eb2596cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45941da6cb4b3a8c7394cc649e62e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:48:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Creating image(s)
Jul 27 13:48:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "/opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "/opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "3783ea8b8a7e57e5833bd476731e6c61c53d3b3d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "3783ea8b8a7e57e5833bd476731e6c61c53d3b3d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d.part --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d.part --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG nova.virt.images [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] 736025cd-261b-456a-91ce-741a180d9332 was qcow2, converting to raw {{(pid=70914) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d.part /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d.converted {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG nova.network.neutron [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Successfully created port: 579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d.part /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d.converted" returned: 0 in 0.358s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d.converted --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "3783ea8b8a7e57e5833bd476731e6c61c53d3b3d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.163s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "3783ea8b8a7e57e5833bd476731e6c61c53d3b3d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "3783ea8b8a7e57e5833bd476731e6c61c53d3b3d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d,backing_fmt=raw /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d,backing_fmt=raw /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk 1073741824" returned: 0 in 0.055s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "3783ea8b8a7e57e5833bd476731e6c61c53d3b3d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d --force-share --output=json" returned: 0 in 0.161s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Cannot resize image /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.objects.instance [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'migration_context' on Instance uuid 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Ensure instance console log exists: /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.network.neutron [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Successfully updated port: 579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquired lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.network.neutron [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-06452b20-e398-41a1-aa50-f3b55376a4aa req-466eeffb-9f20-47ec-9ee0-38235b4abf6b service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-changed-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-06452b20-e398-41a1-aa50-f3b55376a4aa req-466eeffb-9f20-47ec-9ee0-38235b4abf6b service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Refreshing instance network info cache due to event network-changed-579d72f4-5dd4-4666-9beb-2ca8049b1475. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-06452b20-e398-41a1-aa50-f3b55376a4aa req-466eeffb-9f20-47ec-9ee0-38235b4abf6b service nova] Acquiring lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.network.neutron [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:48:41 user nova-compute[70914]: DEBUG nova.network.neutron [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updating instance_info_cache with network_info: [{"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Releasing lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.compute.manager [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Instance network_info: |[{"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-06452b20-e398-41a1-aa50-f3b55376a4aa req-466eeffb-9f20-47ec-9ee0-38235b4abf6b service nova] Acquired lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.network.neutron [req-06452b20-e398-41a1-aa50-f3b55376a4aa req-466eeffb-9f20-47ec-9ee0-38235b4abf6b service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Refreshing network info cache for port 579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Start _get_guest_xml network_info=[{"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:48:35Z,direct_url=<?>,disk_format='qcow2',id=736025cd-261b-456a-91ce-741a180d9332,min_disk=0,min_ram=0,name='tempest-scenario-img--373751460',owner='0b45941da6cb4b3a8c7394cc649e62e5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:48:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '736025cd-261b-456a-91ce-741a180d9332'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:48:42 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:48:42 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:48:35Z,direct_url=<?>,disk_format='qcow2',id=736025cd-261b-456a-91ce-741a180d9332,min_disk=0,min_ram=0,name='tempest-scenario-img--373751460',owner='0b45941da6cb4b3a8c7394cc649e62e5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:48:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-367379119',display_name='tempest-TestMinimumBasicScenario-server-367379119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-367379119',id=32,image_ref='736025cd-261b-456a-91ce-741a180d9332',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaJ1e4bDzGsvRJxN4V/y03/DRGlu2b/BHXmvIrdsQBD3hfNEaGbW+P/W3feD5HfIZS2kA3wU7XxTeJn9zwRzJCZTqHTXBU8cYGwSC9RiGGg0eyIHXNrsrpnFTx97uHyMA==',key_name='tempest-TestMinimumBasicScenario-695460095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45941da6cb4b3a8c7394cc649e62e5',ramdisk_id='',reservation_id='r-3e6qk4p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='736025cd-261b-456a-91ce-741a180d9332',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-779682044',owner_user_name='tempest-TestMinimumBasicScenario-779682044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:48:39Z,user_data=None,user_id='340b2ab1e12b4e0491b86f3eb2596cd1',uuid=2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converting VIF {"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:16:bb,bridge_name='br-int',has_traffic_filtering=True,id=579d72f4-5dd4-4666-9beb-2ca8049b1475,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579d72f4-5d') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.objects.instance [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:48:42 user nova-compute[70914]:   <uuid>2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12</uuid>
Jul 27 13:48:42 user nova-compute[70914]:   <name>instance-00000020</name>
Jul 27 13:48:42 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:48:42 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:48:42 user nova-compute[70914]:   <metadata>
Jul 27 13:48:42 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:48:42 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:48:42 user nova-compute[70914]:       <nova:name>tempest-TestMinimumBasicScenario-server-367379119</nova:name>
Jul 27 13:48:42 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:48:42</nova:creationTime>
Jul 27 13:48:42 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:48:42 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:48:42 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:48:42 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:48:42 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:48:42 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:48:42 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:48:42 user nova-compute[70914]:       <nova:owner>
Jul 27 13:48:42 user nova-compute[70914]:         <nova:user uuid="340b2ab1e12b4e0491b86f3eb2596cd1">tempest-TestMinimumBasicScenario-779682044-project-member</nova:user>
Jul 27 13:48:42 user nova-compute[70914]:         <nova:project uuid="0b45941da6cb4b3a8c7394cc649e62e5">tempest-TestMinimumBasicScenario-779682044</nova:project>
Jul 27 13:48:42 user nova-compute[70914]:       </nova:owner>
Jul 27 13:48:42 user nova-compute[70914]:       <nova:root type="image" uuid="736025cd-261b-456a-91ce-741a180d9332"/>
Jul 27 13:48:42 user nova-compute[70914]:       <nova:ports>
Jul 27 13:48:42 user nova-compute[70914]:         <nova:port uuid="579d72f4-5dd4-4666-9beb-2ca8049b1475">
Jul 27 13:48:42 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 13:48:42 user nova-compute[70914]:         </nova:port>
Jul 27 13:48:42 user nova-compute[70914]:       </nova:ports>
Jul 27 13:48:42 user nova-compute[70914]:     </nova:instance>
Jul 27 13:48:42 user nova-compute[70914]:   </metadata>
Jul 27 13:48:42 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:48:42 user nova-compute[70914]:     <system>
Jul 27 13:48:42 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:48:42 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:48:42 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:48:42 user nova-compute[70914]:       <entry name="serial">2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12</entry>
Jul 27 13:48:42 user nova-compute[70914]:       <entry name="uuid">2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12</entry>
Jul 27 13:48:42 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:48:42 user nova-compute[70914]:     </system>
Jul 27 13:48:42 user nova-compute[70914]:   </sysinfo>
Jul 27 13:48:42 user nova-compute[70914]:   <os>
Jul 27 13:48:42 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:48:42 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:48:42 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:48:42 user nova-compute[70914]:   </os>
Jul 27 13:48:42 user nova-compute[70914]:   <features>
Jul 27 13:48:42 user nova-compute[70914]:     <acpi/>
Jul 27 13:48:42 user nova-compute[70914]:     <apic/>
Jul 27 13:48:42 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:48:42 user nova-compute[70914]:   </features>
Jul 27 13:48:42 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:48:42 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:48:42 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:48:42 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:48:42 user nova-compute[70914]:   </clock>
Jul 27 13:48:42 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:48:42 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:48:42 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:48:42 user nova-compute[70914]:   </cpu>
Jul 27 13:48:42 user nova-compute[70914]:   <devices>
Jul 27 13:48:42 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:48:42 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:48:42 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk"/>
Jul 27 13:48:42 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:48:42 user nova-compute[70914]:     </disk>
Jul 27 13:48:42 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:48:42 user nova-compute[70914]:       <mac address="fa:16:3e:ca:16:bb"/>
Jul 27 13:48:42 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:48:42 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:48:42 user nova-compute[70914]:       <target dev="tap579d72f4-5d"/>
Jul 27 13:48:42 user nova-compute[70914]:     </interface>
Jul 27 13:48:42 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:48:42 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/console.log" append="off"/>
Jul 27 13:48:42 user nova-compute[70914]:     </serial>
Jul 27 13:48:42 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:48:42 user nova-compute[70914]:     <video>
Jul 27 13:48:42 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:48:42 user nova-compute[70914]:     </video>
Jul 27 13:48:42 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:48:42 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:48:42 user nova-compute[70914]:     </rng>
Jul 27 13:48:42 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:48:42 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:48:42 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:48:42 user nova-compute[70914]:     </memballoon>
Jul 27 13:48:42 user nova-compute[70914]:   </devices>
Jul 27 13:48:42 user nova-compute[70914]: </domain>
Jul 27 13:48:42 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-367379119',display_name='tempest-TestMinimumBasicScenario-server-367379119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-367379119',id=32,image_ref='736025cd-261b-456a-91ce-741a180d9332',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaJ1e4bDzGsvRJxN4V/y03/DRGlu2b/BHXmvIrdsQBD3hfNEaGbW+P/W3feD5HfIZS2kA3wU7XxTeJn9zwRzJCZTqHTXBU8cYGwSC9RiGGg0eyIHXNrsrpnFTx97uHyMA==',key_name='tempest-TestMinimumBasicScenario-695460095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45941da6cb4b3a8c7394cc649e62e5',ramdisk_id='',reservation_id='r-3e6qk4p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='736025cd-261b-456a-91ce-741a180d9332',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-779682044',owner_user_name='tempest-TestMinimumBasicScenario-779682044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:48:39Z,user_data=None,user_id='340b2ab1e12b4e0491b86f3eb2596cd1',uuid=2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converting VIF {"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:16:bb,bridge_name='br-int',has_traffic_filtering=True,id=579d72f4-5dd4-4666-9beb-2ca8049b1475,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579d72f4-5d') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG os_vif [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:16:bb,bridge_name='br-int',has_traffic_filtering=True,id=579d72f4-5dd4-4666-9beb-2ca8049b1475,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579d72f4-5d') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap579d72f4-5d, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap579d72f4-5d, col_values=(('external_ids', {'iface-id': '579d72f4-5dd4-4666-9beb-2ca8049b1475', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:16:bb', 'vm-uuid': '2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:42 user nova-compute[70914]: INFO os_vif [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:16:bb,bridge_name='br-int',has_traffic_filtering=True,id=579d72f4-5dd4-4666-9beb-2ca8049b1475,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579d72f4-5d')
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] No VIF found with MAC fa:16:3e:ca:16:bb, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.network.neutron [req-06452b20-e398-41a1-aa50-f3b55376a4aa req-466eeffb-9f20-47ec-9ee0-38235b4abf6b service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updated VIF entry in instance network info cache for port 579d72f4-5dd4-4666-9beb-2ca8049b1475. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG nova.network.neutron [req-06452b20-e398-41a1-aa50-f3b55376a4aa req-466eeffb-9f20-47ec-9ee0-38235b4abf6b service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updating instance_info_cache with network_info: [{"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:48:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-06452b20-e398-41a1-aa50-f3b55376a4aa req-466eeffb-9f20-47ec-9ee0-38235b4abf6b service nova] Releasing lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:48:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-5253b34f-fb23-4540-b2cf-68fae6297f42 req-3536a26a-1698-4cf5-906c-7752175bcdb6 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5253b34f-fb23-4540-b2cf-68fae6297f42 req-3536a26a-1698-4cf5-906c-7752175bcdb6 service nova] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5253b34f-fb23-4540-b2cf-68fae6297f42 req-3536a26a-1698-4cf5-906c-7752175bcdb6 service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5253b34f-fb23-4540-b2cf-68fae6297f42 req-3536a26a-1698-4cf5-906c-7752175bcdb6 service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-5253b34f-fb23-4540-b2cf-68fae6297f42 req-3536a26a-1698-4cf5-906c-7752175bcdb6 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] No waiting events found dispatching network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:44 user nova-compute[70914]: WARNING nova.compute.manager [req-5253b34f-fb23-4540-b2cf-68fae6297f42 req-3536a26a-1698-4cf5-906c-7752175bcdb6 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received unexpected event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 for instance with vm_state building and task_state spawning.
Jul 27 13:48:44 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:48:45 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:48:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:45 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:48:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-3c314786-684c-4ab2-8fb6-ca5b6e8a0311 req-90ce928e-ce5e-41c5-893a-e3899b91cd4e service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3c314786-684c-4ab2-8fb6-ca5b6e8a0311 req-90ce928e-ce5e-41c5-893a-e3899b91cd4e service nova] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3c314786-684c-4ab2-8fb6-ca5b6e8a0311 req-90ce928e-ce5e-41c5-893a-e3899b91cd4e service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-3c314786-684c-4ab2-8fb6-ca5b6e8a0311 req-90ce928e-ce5e-41c5-893a-e3899b91cd4e service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-3c314786-684c-4ab2-8fb6-ca5b6e8a0311 req-90ce928e-ce5e-41c5-893a-e3899b91cd4e service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] No waiting events found dispatching network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:46 user nova-compute[70914]: WARNING nova.compute.manager [req-3c314786-684c-4ab2-8fb6-ca5b6e8a0311 req-90ce928e-ce5e-41c5-893a-e3899b91cd4e service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received unexpected event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 for instance with vm_state building and task_state spawning.
Jul 27 13:48:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:47 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465712.589258, e45fbfcb-0107-4410-b5e1-71ba56995748 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:47 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] VM Stopped (Lifecycle Event)
Jul 27 13:48:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9f9be761-c2fe-42b5-b627-1aabb8e67659 None None] [instance: e45fbfcb-0107-4410-b5e1-71ba56995748] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:48:48 user nova-compute[70914]: INFO nova.compute.claims [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Claim successful on node user
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465728.252174, 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:48 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] VM Resumed (Lifecycle Event)
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:48 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Instance spawned successfully.
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:48 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465728.2546735, 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:48 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] VM Started (Lifecycle Event)
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:48:48 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:48 user nova-compute[70914]: INFO nova.compute.manager [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Took 9.19 seconds to spawn the instance on the hypervisor.
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:48 user nova-compute[70914]: INFO nova.compute.manager [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Took 10.02 seconds to build instance.
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-807ddae6-7cb1-4df8-9930-07f1db4af096 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.155s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:48 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:49 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:48:49 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7653MB free_disk=25.023723602294922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.414s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.035s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.network.neutron [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:48:49 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Applying migration context for instance 3b8cffe7-b0ad-487b-8229-54469afefdd2 as it has an incoming, in-progress migration 824a90a1-a26d-4656-91cb-2fdfc721f212. Migration status is finished {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 13:48:49 user nova-compute[70914]: INFO nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updating resource usage from migration 824a90a1-a26d-4656-91cb-2fdfc721f212
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 1b676522-c547-497a-9b3b-8436f85c7f40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Migration 824a90a1-a26d-4656-91cb-2fdfc721f212 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3b8cffe7-b0ad-487b-8229-54469afefdd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e57eb314-e8bc-42ce-b972-88dff36a0fef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cd4b9913-ab18-42d7-abd7-c4dad48375c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.policy [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89bc44e787074838ba46afd3f81262f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9647080d1194d60aeb390b127895474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:48:49 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Creating image(s)
Jul 27 13:48:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "/opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "/opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.179s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.179s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk 1073741824" returned: 0 in 0.061s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.210s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.030s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Cannot resize image /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG nova.objects.instance [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'migration_context' on Instance uuid cd4b9913-ab18-42d7-abd7-c4dad48375c6 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Ensure instance console log exists: /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:50 user nova-compute[70914]: DEBUG nova.network.neutron [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Successfully created port: 60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:48:51 user nova-compute[70914]: DEBUG nova.network.neutron [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Successfully updated port: 60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:48:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "refresh_cache-cd4b9913-ab18-42d7-abd7-c4dad48375c6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:48:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquired lock "refresh_cache-cd4b9913-ab18-42d7-abd7-c4dad48375c6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:48:51 user nova-compute[70914]: DEBUG nova.network.neutron [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:48:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-966412b0-ba99-42ef-8b63-5f4e4e9ac85c req-64ac5180-309b-49fa-b9c7-fd02c2aac3fa service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Received event network-changed-60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-966412b0-ba99-42ef-8b63-5f4e4e9ac85c req-64ac5180-309b-49fa-b9c7-fd02c2aac3fa service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Refreshing instance network info cache due to event network-changed-60f9c771-b526-401f-bd4e-6c0260665a85. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:48:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-966412b0-ba99-42ef-8b63-5f4e4e9ac85c req-64ac5180-309b-49fa-b9c7-fd02c2aac3fa service nova] Acquiring lock "refresh_cache-cd4b9913-ab18-42d7-abd7-c4dad48375c6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:48:51 user nova-compute[70914]: DEBUG nova.network.neutron [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.network.neutron [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Updating instance_info_cache with network_info: [{"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Releasing lock "refresh_cache-cd4b9913-ab18-42d7-abd7-c4dad48375c6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Instance network_info: |[{"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-966412b0-ba99-42ef-8b63-5f4e4e9ac85c req-64ac5180-309b-49fa-b9c7-fd02c2aac3fa service nova] Acquired lock "refresh_cache-cd4b9913-ab18-42d7-abd7-c4dad48375c6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-966412b0-ba99-42ef-8b63-5f4e4e9ac85c req-64ac5180-309b-49fa-b9c7-fd02c2aac3fa service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Refreshing network info cache for port 60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Start _get_guest_xml network_info=[{"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:48:52 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:48:52 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2145298011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2145298011',id=33,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-0ksdyyic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:48:50Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=cd4b9913-ab18-42d7-abd7-c4dad48375c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:08,bridge_name='br-int',has_traffic_filtering=True,id=60f9c771-b526-401f-bd4e-6c0260665a85,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f9c771-b5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.objects.instance [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'pci_devices' on Instance uuid cd4b9913-ab18-42d7-abd7-c4dad48375c6 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:48:52 user nova-compute[70914]:   <uuid>cd4b9913-ab18-42d7-abd7-c4dad48375c6</uuid>
Jul 27 13:48:52 user nova-compute[70914]:   <name>instance-00000021</name>
Jul 27 13:48:52 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:48:52 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:48:52 user nova-compute[70914]:   <metadata>
Jul 27 13:48:52 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:48:52 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:48:52 user nova-compute[70914]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2145298011</nova:name>
Jul 27 13:48:52 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:48:52</nova:creationTime>
Jul 27 13:48:52 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:48:52 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:48:52 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:48:52 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:48:52 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:48:52 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:48:52 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:48:52 user nova-compute[70914]:       <nova:owner>
Jul 27 13:48:52 user nova-compute[70914]:         <nova:user uuid="89bc44e787074838ba46afd3f81262f0">tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member</nova:user>
Jul 27 13:48:52 user nova-compute[70914]:         <nova:project uuid="e9647080d1194d60aeb390b127895474">tempest-ServerBootFromVolumeStableRescueTest-853279030</nova:project>
Jul 27 13:48:52 user nova-compute[70914]:       </nova:owner>
Jul 27 13:48:52 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:48:52 user nova-compute[70914]:       <nova:ports>
Jul 27 13:48:52 user nova-compute[70914]:         <nova:port uuid="60f9c771-b526-401f-bd4e-6c0260665a85">
Jul 27 13:48:52 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 13:48:52 user nova-compute[70914]:         </nova:port>
Jul 27 13:48:52 user nova-compute[70914]:       </nova:ports>
Jul 27 13:48:52 user nova-compute[70914]:     </nova:instance>
Jul 27 13:48:52 user nova-compute[70914]:   </metadata>
Jul 27 13:48:52 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:48:52 user nova-compute[70914]:     <system>
Jul 27 13:48:52 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:48:52 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:48:52 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:48:52 user nova-compute[70914]:       <entry name="serial">cd4b9913-ab18-42d7-abd7-c4dad48375c6</entry>
Jul 27 13:48:52 user nova-compute[70914]:       <entry name="uuid">cd4b9913-ab18-42d7-abd7-c4dad48375c6</entry>
Jul 27 13:48:52 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:48:52 user nova-compute[70914]:     </system>
Jul 27 13:48:52 user nova-compute[70914]:   </sysinfo>
Jul 27 13:48:52 user nova-compute[70914]:   <os>
Jul 27 13:48:52 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:48:52 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:48:52 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:48:52 user nova-compute[70914]:   </os>
Jul 27 13:48:52 user nova-compute[70914]:   <features>
Jul 27 13:48:52 user nova-compute[70914]:     <acpi/>
Jul 27 13:48:52 user nova-compute[70914]:     <apic/>
Jul 27 13:48:52 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:48:52 user nova-compute[70914]:   </features>
Jul 27 13:48:52 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:48:52 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:48:52 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:48:52 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:48:52 user nova-compute[70914]:   </clock>
Jul 27 13:48:52 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:48:52 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:48:52 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:48:52 user nova-compute[70914]:   </cpu>
Jul 27 13:48:52 user nova-compute[70914]:   <devices>
Jul 27 13:48:52 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:48:52 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:48:52 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk"/>
Jul 27 13:48:52 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:48:52 user nova-compute[70914]:     </disk>
Jul 27 13:48:52 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:48:52 user nova-compute[70914]:       <mac address="fa:16:3e:ab:f1:08"/>
Jul 27 13:48:52 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:48:52 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:48:52 user nova-compute[70914]:       <target dev="tap60f9c771-b5"/>
Jul 27 13:48:52 user nova-compute[70914]:     </interface>
Jul 27 13:48:52 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:48:52 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/console.log" append="off"/>
Jul 27 13:48:52 user nova-compute[70914]:     </serial>
Jul 27 13:48:52 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:48:52 user nova-compute[70914]:     <video>
Jul 27 13:48:52 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:48:52 user nova-compute[70914]:     </video>
Jul 27 13:48:52 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:48:52 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:48:52 user nova-compute[70914]:     </rng>
Jul 27 13:48:52 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:48:52 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:48:52 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:48:52 user nova-compute[70914]:     </memballoon>
Jul 27 13:48:52 user nova-compute[70914]:   </devices>
Jul 27 13:48:52 user nova-compute[70914]: </domain>
Jul 27 13:48:52 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2145298011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2145298011',id=33,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-0ksdyyic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:48:50Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=cd4b9913-ab18-42d7-abd7-c4dad48375c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:08,bridge_name='br-int',has_traffic_filtering=True,id=60f9c771-b526-401f-bd4e-6c0260665a85,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f9c771-b5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG os_vif [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:08,bridge_name='br-int',has_traffic_filtering=True,id=60f9c771-b526-401f-bd4e-6c0260665a85,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f9c771-b5') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60f9c771-b5, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60f9c771-b5, col_values=(('external_ids', {'iface-id': '60f9c771-b526-401f-bd4e-6c0260665a85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:f1:08', 'vm-uuid': 'cd4b9913-ab18-42d7-abd7-c4dad48375c6'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:52 user nova-compute[70914]: INFO os_vif [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:08,bridge_name='br-int',has_traffic_filtering=True,id=60f9c771-b526-401f-bd4e-6c0260665a85,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f9c771-b5')
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No VIF found with MAC fa:16:3e:ab:f1:08, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-966412b0-ba99-42ef-8b63-5f4e4e9ac85c req-64ac5180-309b-49fa-b9c7-fd02c2aac3fa service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Updated VIF entry in instance network info cache for port 60f9c771-b526-401f-bd4e-6c0260665a85. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG nova.network.neutron [req-966412b0-ba99-42ef-8b63-5f4e4e9ac85c req-64ac5180-309b-49fa-b9c7-fd02c2aac3fa service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Updating instance_info_cache with network_info: [{"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:48:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-966412b0-ba99-42ef-8b63-5f4e4e9ac85c req-64ac5180-309b-49fa-b9c7-fd02c2aac3fa service nova] Releasing lock "refresh_cache-cd4b9913-ab18-42d7-abd7-c4dad48375c6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:48:53 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:48:53 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:48:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:48:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:48:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:48:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:48:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-f82087cb-dc6e-49d0-a0ba-1fc6149ccb05 req-e5088a0f-a51b-46ab-867f-849a163a818a service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Received event network-vif-plugged-60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f82087cb-dc6e-49d0-a0ba-1fc6149ccb05 req-e5088a0f-a51b-46ab-867f-849a163a818a service nova] Acquiring lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f82087cb-dc6e-49d0-a0ba-1fc6149ccb05 req-e5088a0f-a51b-46ab-867f-849a163a818a service nova] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f82087cb-dc6e-49d0-a0ba-1fc6149ccb05 req-e5088a0f-a51b-46ab-867f-849a163a818a service nova] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-f82087cb-dc6e-49d0-a0ba-1fc6149ccb05 req-e5088a0f-a51b-46ab-867f-849a163a818a service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] No waiting events found dispatching network-vif-plugged-60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:54 user nova-compute[70914]: WARNING nova.compute.manager [req-f82087cb-dc6e-49d0-a0ba-1fc6149ccb05 req-e5088a0f-a51b-46ab-867f-849a163a818a service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Received unexpected event network-vif-plugged-60f9c771-b526-401f-bd4e-6c0260665a85 for instance with vm_state building and task_state spawning.
Jul 27 13:48:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Updating instance_info_cache with network_info: [{"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:48:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465736.3313124, cd4b9913-ab18-42d7-abd7-c4dad48375c6 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] VM Resumed (Lifecycle Event)
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-1aec7240-6dc1-4553-9fae-4d6f2c4fe50e req-f99b826f-e9e6-4fab-9d32-d21870a1dc0a service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Received event network-vif-plugged-60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1aec7240-6dc1-4553-9fae-4d6f2c4fe50e req-f99b826f-e9e6-4fab-9d32-d21870a1dc0a service nova] Acquiring lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1aec7240-6dc1-4553-9fae-4d6f2c4fe50e req-f99b826f-e9e6-4fab-9d32-d21870a1dc0a service nova] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1aec7240-6dc1-4553-9fae-4d6f2c4fe50e req-f99b826f-e9e6-4fab-9d32-d21870a1dc0a service nova] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-1aec7240-6dc1-4553-9fae-4d6f2c4fe50e req-f99b826f-e9e6-4fab-9d32-d21870a1dc0a service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] No waiting events found dispatching network-vif-plugged-60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:56 user nova-compute[70914]: WARNING nova.compute.manager [req-1aec7240-6dc1-4553-9fae-4d6f2c4fe50e req-f99b826f-e9e6-4fab-9d32-d21870a1dc0a service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Received unexpected event network-vif-plugged-60f9c771-b526-401f-bd4e-6c0260665a85 for instance with vm_state building and task_state spawning.
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:56 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Instance spawned successfully.
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:48:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465736.3457537, cd4b9913-ab18-42d7-abd7-c4dad48375c6 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:48:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] VM Started (Lifecycle Event)
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:48:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:48:56 user nova-compute[70914]: INFO nova.compute.manager [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Took 6.53 seconds to spawn the instance on the hypervisor.
Jul 27 13:48:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:48:56 user nova-compute[70914]: INFO nova.compute.manager [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Took 8.41 seconds to build instance.
Jul 27 13:48:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fd962ff8-e6fc-48b0-8864-1ef09bad3d41 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.559s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:59 user nova-compute[70914]: INFO nova.compute.manager [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Terminating instance
Jul 27 13:48:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-097798ca-55bc-43d4-ad6a-a9b8f77e5dab req-35eef758-b712-4fc1-95bb-84b762557b26 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-vif-unplugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-097798ca-55bc-43d4-ad6a-a9b8f77e5dab req-35eef758-b712-4fc1-95bb-84b762557b26 service nova] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-097798ca-55bc-43d4-ad6a-a9b8f77e5dab req-35eef758-b712-4fc1-95bb-84b762557b26 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-097798ca-55bc-43d4-ad6a-a9b8f77e5dab req-35eef758-b712-4fc1-95bb-84b762557b26 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-097798ca-55bc-43d4-ad6a-a9b8f77e5dab req-35eef758-b712-4fc1-95bb-84b762557b26 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] No waiting events found dispatching network-vif-unplugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:48:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-097798ca-55bc-43d4-ad6a-a9b8f77e5dab req-35eef758-b712-4fc1-95bb-84b762557b26 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-vif-unplugged-ef1f245c-0a46-4cd8-8851-c93741559d97 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:49:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Instance destroyed successfully.
Jul 27 13:49:00 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'resources' on Instance uuid 4e856bc3-ce45-4307-af2b-33c82ed1eccc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:49:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1002806692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1002806692',id=24,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOp7kA5GsVKxK7vy6xGG3HUQDmGrBeuuo/lroY6vdSLHo0PMS4wZK7mlc0LUUIgDVuztVrn2KZy3eXeePOKG+URgPP4gtVe8S6ZdIaDay/2vu1i1r/qxxoyr11tBYjQurw==',key_name='tempest-keypair-1688577340',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:46:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-2uukqca4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:46:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=4e856bc3-ce45-4307-af2b-33c82ed1eccc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:49:00 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "ef1f245c-0a46-4cd8-8851-c93741559d97", "address": "fa:16:3e:7e:b8:3f", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1f245c-0a", "ovs_interfaceid": "ef1f245c-0a46-4cd8-8851-c93741559d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:49:00 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:49:00 user nova-compute[70914]: DEBUG os_vif [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:49:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef1f245c-0a, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:49:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:49:00 user nova-compute[70914]: INFO os_vif [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=ef1f245c-0a46-4cd8-8851-c93741559d97,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1f245c-0a')
Jul 27 13:49:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Deleting instance files /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc_del
Jul 27 13:49:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Deletion of /opt/stack/data/nova/instances/4e856bc3-ce45-4307-af2b-33c82ed1eccc_del complete
Jul 27 13:49:00 user nova-compute[70914]: INFO nova.compute.manager [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 27 13:49:00 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:49:00 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:49:00 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:49:01 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:49:01 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Took 1.01 seconds to deallocate network for instance.
Jul 27 13:49:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:01 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:49:01 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:49:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-e2be4ebd-1eee-4574-ac30-0f553e719a7a req-c2b827e6-93c9-4426-927d-2090097934d4 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e2be4ebd-1eee-4574-ac30-0f553e719a7a req-c2b827e6-93c9-4426-927d-2090097934d4 service nova] Acquiring lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e2be4ebd-1eee-4574-ac30-0f553e719a7a req-c2b827e6-93c9-4426-927d-2090097934d4 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e2be4ebd-1eee-4574-ac30-0f553e719a7a req-c2b827e6-93c9-4426-927d-2090097934d4 service nova] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-e2be4ebd-1eee-4574-ac30-0f553e719a7a req-c2b827e6-93c9-4426-927d-2090097934d4 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] No waiting events found dispatching network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:49:01 user nova-compute[70914]: WARNING nova.compute.manager [req-e2be4ebd-1eee-4574-ac30-0f553e719a7a req-c2b827e6-93c9-4426-927d-2090097934d4 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received unexpected event network-vif-plugged-ef1f245c-0a46-4cd8-8851-c93741559d97 for instance with vm_state deleted and task_state None.
Jul 27 13:49:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-e2be4ebd-1eee-4574-ac30-0f553e719a7a req-c2b827e6-93c9-4426-927d-2090097934d4 service nova] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Received event network-vif-deleted-ef1f245c-0a46-4cd8-8851-c93741559d97 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:01 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Deleted allocations for instance 4e856bc3-ce45-4307-af2b-33c82ed1eccc
Jul 27 13:49:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f85d17a-728b-4c07-a71f-4e1de4b983df tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "4e856bc3-ce45-4307-af2b-33c82ed1eccc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.606s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:15 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465740.1518502, 4e856bc3-ce45-4307-af2b-33c82ed1eccc => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:49:15 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] VM Stopped (Lifecycle Event)
Jul 27 13:49:15 user nova-compute[70914]: DEBUG nova.compute.manager [None req-175c7233-56c9-4f56-994f-39100b54168d None None] [instance: 4e856bc3-ce45-4307-af2b-33c82ed1eccc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:49:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "1b676522-c547-497a-9b3b-8436f85c7f40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:22 user nova-compute[70914]: INFO nova.compute.manager [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Terminating instance
Jul 27 13:49:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-ba336b58-047b-42f7-8838-f75e4c73bbe2 req-dbdd437c-7d2a-4ef5-8deb-8c9249972a80 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ba336b58-047b-42f7-8838-f75e4c73bbe2 req-dbdd437c-7d2a-4ef5-8deb-8c9249972a80 service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ba336b58-047b-42f7-8838-f75e4c73bbe2 req-dbdd437c-7d2a-4ef5-8deb-8c9249972a80 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ba336b58-047b-42f7-8838-f75e4c73bbe2 req-dbdd437c-7d2a-4ef5-8deb-8c9249972a80 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-ba336b58-047b-42f7-8838-f75e4c73bbe2 req-dbdd437c-7d2a-4ef5-8deb-8c9249972a80 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:49:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-ba336b58-047b-42f7-8838-f75e4c73bbe2 req-dbdd437c-7d2a-4ef5-8deb-8c9249972a80 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-unplugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:49:23 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Instance destroyed successfully.
Jul 27 13:49:23 user nova-compute[70914]: DEBUG nova.objects.instance [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lazy-loading 'resources' on Instance uuid 1b676522-c547-497a-9b3b-8436f85c7f40 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1172859920',display_name='tempest-ServerRescueNegativeTestJSON-server-1172859920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1172859920',id=1,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097b177edc7249f798bca2c39a33394d',ramdisk_id='',reservation_id='r-rf0p6iln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1275773337',owner_user_name='tempest-ServerRescueNegativeTestJSON-1275773337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:38:58Z,user_data=None,user_id='a0d92b0b34814e75a7709e09e357be07',uuid=1b676522-c547-497a-9b3b-8436f85c7f40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converting VIF {"id": "15896fd3-c444-414b-81ae-8594251d3c8e", "address": "fa:16:3e:73:0e:6b", "network": {"id": "4f0e6a07-e892-4b6e-bacf-2ede680d90da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15470588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b177edc7249f798bca2c39a33394d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15896fd3-c4", "ovs_interfaceid": "15896fd3-c444-414b-81ae-8594251d3c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:0e:6b,bridge_name='br-int',has_traffic_filtering=True,id=15896fd3-c444-414b-81ae-8594251d3c8e,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15896fd3-c4') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG os_vif [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:0e:6b,bridge_name='br-int',has_traffic_filtering=True,id=15896fd3-c444-414b-81ae-8594251d3c8e,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15896fd3-c4') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15896fd3-c4, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:23 user nova-compute[70914]: INFO os_vif [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:0e:6b,bridge_name='br-int',has_traffic_filtering=True,id=15896fd3-c444-414b-81ae-8594251d3c8e,network=Network(4f0e6a07-e892-4b6e-bacf-2ede680d90da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15896fd3-c4')
Jul 27 13:49:23 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Deleting instance files /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40_del
Jul 27 13:49:23 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Deletion of /opt/stack/data/nova/instances/1b676522-c547-497a-9b3b-8436f85c7f40_del complete
Jul 27 13:49:23 user nova-compute[70914]: INFO nova.compute.manager [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 13:49:23 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:49:23 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:49:24 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Took 0.69 seconds to deallocate network for instance.
Jul 27 13:49:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:24 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:49:24 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:49:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:24 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Deleted allocations for instance 1b676522-c547-497a-9b3b-8436f85c7f40
Jul 27 13:49:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-472c20ca-9fb5-4845-b9a5-825e1597f89a tempest-ServerRescueNegativeTestJSON-1275773337 tempest-ServerRescueNegativeTestJSON-1275773337-project-member] Lock "1b676522-c547-497a-9b3b-8436f85c7f40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.139s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-bb91d2b9-3e16-421b-abcb-e1094f1dd841 req-fa4bf2b4-0aaf-460a-a42e-621d4713d5f1 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bb91d2b9-3e16-421b-abcb-e1094f1dd841 req-fa4bf2b4-0aaf-460a-a42e-621d4713d5f1 service nova] Acquiring lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bb91d2b9-3e16-421b-abcb-e1094f1dd841 req-fa4bf2b4-0aaf-460a-a42e-621d4713d5f1 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bb91d2b9-3e16-421b-abcb-e1094f1dd841 req-fa4bf2b4-0aaf-460a-a42e-621d4713d5f1 service nova] Lock "1b676522-c547-497a-9b3b-8436f85c7f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-bb91d2b9-3e16-421b-abcb-e1094f1dd841 req-fa4bf2b4-0aaf-460a-a42e-621d4713d5f1 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] No waiting events found dispatching network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:49:24 user nova-compute[70914]: WARNING nova.compute.manager [req-bb91d2b9-3e16-421b-abcb-e1094f1dd841 req-fa4bf2b4-0aaf-460a-a42e-621d4713d5f1 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received unexpected event network-vif-plugged-15896fd3-c444-414b-81ae-8594251d3c8e for instance with vm_state deleted and task_state None.
Jul 27 13:49:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-bb91d2b9-3e16-421b-abcb-e1094f1dd841 req-fa4bf2b4-0aaf-460a-a42e-621d4713d5f1 service nova] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Received event network-vif-deleted-15896fd3-c444-414b-81ae-8594251d3c8e {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:29 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:49:30 user nova-compute[70914]: INFO nova.compute.claims [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Claim successful on node user
Jul 27 13:49:30 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:49:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:49:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG nova.policy [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0d5277a420b42bfb40dfc0196fea575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c2842f73314df7b38893d27acf46e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:49:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Creating image(s)
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "/opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "/opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "/opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk 1073741824" returned: 0 in 0.050s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Cannot resize image /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'migration_context' on Instance uuid e203cf51-97bf-4fc7-aa94-3a604c862abd {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Successfully created port: b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Ensure instance console log exists: /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Successfully updated port: b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-2f337da8-5016-445b-8cc2-c42e593c4251 req-6728d83f-718b-4f25-8fd2-bd607e5c7eed service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received event network-changed-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-2f337da8-5016-445b-8cc2-c42e593c4251 req-6728d83f-718b-4f25-8fd2-bd607e5c7eed service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Refreshing instance network info cache due to event network-changed-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2f337da8-5016-445b-8cc2-c42e593c4251 req-6728d83f-718b-4f25-8fd2-bd607e5c7eed service nova] Acquiring lock "refresh_cache-e203cf51-97bf-4fc7-aa94-3a604c862abd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2f337da8-5016-445b-8cc2-c42e593c4251 req-6728d83f-718b-4f25-8fd2-bd607e5c7eed service nova] Acquired lock "refresh_cache-e203cf51-97bf-4fc7-aa94-3a604c862abd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-2f337da8-5016-445b-8cc2-c42e593c4251 req-6728d83f-718b-4f25-8fd2-bd607e5c7eed service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Refreshing network info cache for port b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-2f337da8-5016-445b-8cc2-c42e593c4251 req-6728d83f-718b-4f25-8fd2-bd607e5c7eed service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "refresh_cache-e203cf51-97bf-4fc7-aa94-3a604c862abd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-2f337da8-5016-445b-8cc2-c42e593c4251 req-6728d83f-718b-4f25-8fd2-bd607e5c7eed service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2f337da8-5016-445b-8cc2-c42e593c4251 req-6728d83f-718b-4f25-8fd2-bd607e5c7eed service nova] Releasing lock "refresh_cache-e203cf51-97bf-4fc7-aa94-3a604c862abd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquired lock "refresh_cache-e203cf51-97bf-4fc7-aa94-3a604c862abd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Updating instance_info_cache with network_info: [{"id": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "address": "fa:16:3e:f8:a5:1f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3038fab-e5", "ovs_interfaceid": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Releasing lock "refresh_cache-e203cf51-97bf-4fc7-aa94-3a604c862abd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Instance network_info: |[{"id": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "address": "fa:16:3e:f8:a5:1f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3038fab-e5", "ovs_interfaceid": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Start _get_guest_xml network_info=[{"id": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "address": "fa:16:3e:f8:a5:1f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3038fab-e5", "ovs_interfaceid": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:49:32 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:49:32 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:49:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1668108360',display_name='tempest-VolumesSnapshotTestJSON-instance-1668108360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1668108360',id=34,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnMqYjKNGmrC6z6D/LBZy6ziXHX9g8wCb4kr8i/pn6E1f1G2yijkMU99d4vhl+cL3XL+eVyo6Xu5sQNKn8eOkEf671IozyXRvcuFOTm68HTz2nQMaR9ajjXvmea9iY5QQ==',key_name='tempest-keypair-106311766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82c2842f73314df7b38893d27acf46e0',ramdisk_id='',reservation_id='r-pebasj9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-277407372',owner_user_name='tempest-VolumesSnapshotTestJSON-277407372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0d5277a420b42bfb40dfc0196fea575',uuid=e203cf51-97bf-4fc7-aa94-3a604c862abd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "address": "fa:16:3e:f8:a5:1f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3038fab-e5", "ovs_interfaceid": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converting VIF {"id": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "address": "fa:16:3e:f8:a5:1f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3038fab-e5", "ovs_interfaceid": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a5:1f,bridge_name='br-int',has_traffic_filtering=True,id=b3038fab-e57c-42fa-94da-f8aaf1a3fd3d,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3038fab-e5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.objects.instance [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'pci_devices' on Instance uuid e203cf51-97bf-4fc7-aa94-3a604c862abd {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:49:32 user nova-compute[70914]:   <uuid>e203cf51-97bf-4fc7-aa94-3a604c862abd</uuid>
Jul 27 13:49:32 user nova-compute[70914]:   <name>instance-00000022</name>
Jul 27 13:49:32 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:49:32 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:49:32 user nova-compute[70914]:   <metadata>
Jul 27 13:49:32 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:49:32 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:49:32 user nova-compute[70914]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1668108360</nova:name>
Jul 27 13:49:32 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:49:32</nova:creationTime>
Jul 27 13:49:32 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:49:32 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:49:32 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:49:32 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:49:32 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:49:32 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:49:32 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:49:32 user nova-compute[70914]:       <nova:owner>
Jul 27 13:49:32 user nova-compute[70914]:         <nova:user uuid="b0d5277a420b42bfb40dfc0196fea575">tempest-VolumesSnapshotTestJSON-277407372-project-member</nova:user>
Jul 27 13:49:32 user nova-compute[70914]:         <nova:project uuid="82c2842f73314df7b38893d27acf46e0">tempest-VolumesSnapshotTestJSON-277407372</nova:project>
Jul 27 13:49:32 user nova-compute[70914]:       </nova:owner>
Jul 27 13:49:32 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:49:32 user nova-compute[70914]:       <nova:ports>
Jul 27 13:49:32 user nova-compute[70914]:         <nova:port uuid="b3038fab-e57c-42fa-94da-f8aaf1a3fd3d">
Jul 27 13:49:32 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 13:49:32 user nova-compute[70914]:         </nova:port>
Jul 27 13:49:32 user nova-compute[70914]:       </nova:ports>
Jul 27 13:49:32 user nova-compute[70914]:     </nova:instance>
Jul 27 13:49:32 user nova-compute[70914]:   </metadata>
Jul 27 13:49:32 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:49:32 user nova-compute[70914]:     <system>
Jul 27 13:49:32 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:49:32 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:49:32 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:49:32 user nova-compute[70914]:       <entry name="serial">e203cf51-97bf-4fc7-aa94-3a604c862abd</entry>
Jul 27 13:49:32 user nova-compute[70914]:       <entry name="uuid">e203cf51-97bf-4fc7-aa94-3a604c862abd</entry>
Jul 27 13:49:32 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:49:32 user nova-compute[70914]:     </system>
Jul 27 13:49:32 user nova-compute[70914]:   </sysinfo>
Jul 27 13:49:32 user nova-compute[70914]:   <os>
Jul 27 13:49:32 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:49:32 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:49:32 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:49:32 user nova-compute[70914]:   </os>
Jul 27 13:49:32 user nova-compute[70914]:   <features>
Jul 27 13:49:32 user nova-compute[70914]:     <acpi/>
Jul 27 13:49:32 user nova-compute[70914]:     <apic/>
Jul 27 13:49:32 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:49:32 user nova-compute[70914]:   </features>
Jul 27 13:49:32 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:49:32 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:49:32 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:49:32 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:49:32 user nova-compute[70914]:   </clock>
Jul 27 13:49:32 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:49:32 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:49:32 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:49:32 user nova-compute[70914]:   </cpu>
Jul 27 13:49:32 user nova-compute[70914]:   <devices>
Jul 27 13:49:32 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:49:32 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:49:32 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk"/>
Jul 27 13:49:32 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:49:32 user nova-compute[70914]:     </disk>
Jul 27 13:49:32 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:49:32 user nova-compute[70914]:       <mac address="fa:16:3e:f8:a5:1f"/>
Jul 27 13:49:32 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:49:32 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:49:32 user nova-compute[70914]:       <target dev="tapb3038fab-e5"/>
Jul 27 13:49:32 user nova-compute[70914]:     </interface>
Jul 27 13:49:32 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:49:32 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/console.log" append="off"/>
Jul 27 13:49:32 user nova-compute[70914]:     </serial>
Jul 27 13:49:32 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:49:32 user nova-compute[70914]:     <video>
Jul 27 13:49:32 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:49:32 user nova-compute[70914]:     </video>
Jul 27 13:49:32 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:49:32 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:49:32 user nova-compute[70914]:     </rng>
Jul 27 13:49:32 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:49:32 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:49:32 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:49:32 user nova-compute[70914]:     </memballoon>
Jul 27 13:49:32 user nova-compute[70914]:   </devices>
Jul 27 13:49:32 user nova-compute[70914]: </domain>
Jul 27 13:49:32 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:49:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1668108360',display_name='tempest-VolumesSnapshotTestJSON-instance-1668108360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1668108360',id=34,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnMqYjKNGmrC6z6D/LBZy6ziXHX9g8wCb4kr8i/pn6E1f1G2yijkMU99d4vhl+cL3XL+eVyo6Xu5sQNKn8eOkEf671IozyXRvcuFOTm68HTz2nQMaR9ajjXvmea9iY5QQ==',key_name='tempest-keypair-106311766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82c2842f73314df7b38893d27acf46e0',ramdisk_id='',reservation_id='r-pebasj9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-277407372',owner_user_name='tempest-VolumesSnapshotTestJSON-277407372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0d5277a420b42bfb40dfc0196fea575',uuid=e203cf51-97bf-4fc7-aa94-3a604c862abd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "address": "fa:16:3e:f8:a5:1f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3038fab-e5", "ovs_interfaceid": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converting VIF {"id": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "address": "fa:16:3e:f8:a5:1f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3038fab-e5", "ovs_interfaceid": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a5:1f,bridge_name='br-int',has_traffic_filtering=True,id=b3038fab-e57c-42fa-94da-f8aaf1a3fd3d,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3038fab-e5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG os_vif [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a5:1f,bridge_name='br-int',has_traffic_filtering=True,id=b3038fab-e57c-42fa-94da-f8aaf1a3fd3d,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3038fab-e5') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:49:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:49:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3038fab-e5, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:49:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3038fab-e5, col_values=(('external_ids', {'iface-id': 'b3038fab-e57c-42fa-94da-f8aaf1a3fd3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:a5:1f', 'vm-uuid': 'e203cf51-97bf-4fc7-aa94-3a604c862abd'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:49:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:49:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:33 user nova-compute[70914]: INFO os_vif [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a5:1f,bridge_name='br-int',has_traffic_filtering=True,id=b3038fab-e57c-42fa-94da-f8aaf1a3fd3d,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3038fab-e5')
Jul 27 13:49:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:49:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] No VIF found with MAC fa:16:3e:f8:a5:1f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:49:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-0ee6ef5f-3b7e-402a-ba56-b1a83266499b req-fdc3b914-9f50-4d37-a3b6-ba2bab725fe7 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received event network-vif-plugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ee6ef5f-3b7e-402a-ba56-b1a83266499b req-fdc3b914-9f50-4d37-a3b6-ba2bab725fe7 service nova] Acquiring lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ee6ef5f-3b7e-402a-ba56-b1a83266499b req-fdc3b914-9f50-4d37-a3b6-ba2bab725fe7 service nova] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0ee6ef5f-3b7e-402a-ba56-b1a83266499b req-fdc3b914-9f50-4d37-a3b6-ba2bab725fe7 service nova] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-0ee6ef5f-3b7e-402a-ba56-b1a83266499b req-fdc3b914-9f50-4d37-a3b6-ba2bab725fe7 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] No waiting events found dispatching network-vif-plugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:49:34 user nova-compute[70914]: WARNING nova.compute.manager [req-0ee6ef5f-3b7e-402a-ba56-b1a83266499b req-fdc3b914-9f50-4d37-a3b6-ba2bab725fe7 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received unexpected event network-vif-plugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d for instance with vm_state building and task_state spawning.
Jul 27 13:49:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465776.581579, e203cf51-97bf-4fc7-aa94-3a604c862abd => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:49:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] VM Resumed (Lifecycle Event)
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:49:36 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Instance spawned successfully.
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:49:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465776.5824983, e203cf51-97bf-4fc7-aa94-3a604c862abd => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:49:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] VM Started (Lifecycle Event)
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:49:36 user nova-compute[70914]: INFO nova.compute.manager [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Took 6.01 seconds to spawn the instance on the hypervisor.
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-7148adfb-3bfe-48a5-862d-7af7b967ec11 req-d480eb95-011a-4c84-9601-bd92d9b26808 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received event network-vif-plugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7148adfb-3bfe-48a5-862d-7af7b967ec11 req-d480eb95-011a-4c84-9601-bd92d9b26808 service nova] Acquiring lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7148adfb-3bfe-48a5-862d-7af7b967ec11 req-d480eb95-011a-4c84-9601-bd92d9b26808 service nova] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7148adfb-3bfe-48a5-862d-7af7b967ec11 req-d480eb95-011a-4c84-9601-bd92d9b26808 service nova] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-7148adfb-3bfe-48a5-862d-7af7b967ec11 req-d480eb95-011a-4c84-9601-bd92d9b26808 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] No waiting events found dispatching network-vif-plugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:49:36 user nova-compute[70914]: WARNING nova.compute.manager [req-7148adfb-3bfe-48a5-862d-7af7b967ec11 req-d480eb95-011a-4c84-9601-bd92d9b26808 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received unexpected event network-vif-plugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d for instance with vm_state building and task_state spawning.
Jul 27 13:49:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:49:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:49:36 user nova-compute[70914]: INFO nova.compute.manager [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Took 6.83 seconds to build instance.
Jul 27 13:49:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-49dfb355-9eb1-4623-9ae2-5bebff9cd6e1 tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.936s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:38 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465763.2094855, 1b676522-c547-497a-9b3b-8436f85c7f40 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:49:38 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] VM Stopped (Lifecycle Event)
Jul 27 13:49:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4f2a936d-4032-44d5-b6c1-55173bb79658 None None] [instance: 1b676522-c547-497a-9b3b-8436f85c7f40] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:49:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Going to confirm migration 2 {{(pid=70914) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 27 13:49:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:49:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquired lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:49:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:49:45 user nova-compute[70914]: DEBUG nova.objects.instance [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'info_cache' on Instance uuid 3b8cffe7-b0ad-487b-8229-54469afefdd2 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:49:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updating instance_info_cache with network_info: [{"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:49:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Releasing lock "refresh_cache-3b8cffe7-b0ad-487b-8229-54469afefdd2" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:49:45 user nova-compute[70914]: DEBUG nova.objects.instance [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'migration_context' on Instance uuid 3b8cffe7-b0ad-487b-8229-54469afefdd2 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:49:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:46 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:49:46 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:49:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.655s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:46 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Deleted allocation for migration 824a90a1-a26d-4656-91cb-2fdfc721f212
Jul 27 13:49:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2a4f2f9a-caa7-4ed5-adcd-8f5bb17cea39 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.593s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:46 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:49:47 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:49:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:47 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:49:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:48 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:49:49 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:49:49 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:49:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=25.30310821533203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3b8cffe7-b0ad-487b-8229-54469afefdd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e57eb314-e8bc-42ce-b972-88dff36a0fef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cd4b9913-ab18-42d7-abd7-c4dad48375c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e203cf51-97bf-4fc7-aa94-3a604c862abd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:49:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:49:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:49:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:49:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:49:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:49:53 user nova-compute[70914]: INFO nova.compute.claims [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Claim successful on node user
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:49:53 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.policy [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce42c397b5d44afd9c12497b2bf40fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c132beeb2d43b1b568da4492f2ffc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:49:53 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Creating image(s)
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "/opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "/opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "/opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updating instance_info_cache with network_info: [{"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.183s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk 1073741824" returned: 0 in 0.050s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG nova.network.neutron [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Successfully created port: 6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Cannot resize image /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG nova.objects.instance [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'migration_context' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Ensure instance console log exists: /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Successfully updated port: 6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquired lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-7bf0decd-b667-4c13-97df-e6b379e013c6 req-9a98451b-24d2-41e0-b455-e5785fc6f4f7 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-changed-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-7bf0decd-b667-4c13-97df-e6b379e013c6 req-9a98451b-24d2-41e0-b455-e5785fc6f4f7 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Refreshing instance network info cache due to event network-changed-6ce0387e-c296-41be-b5e6-9d5ab538cec8. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7bf0decd-b667-4c13-97df-e6b379e013c6 req-9a98451b-24d2-41e0-b455-e5785fc6f4f7 service nova] Acquiring lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updating instance_info_cache with network_info: [{"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Releasing lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance network_info: |[{"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7bf0decd-b667-4c13-97df-e6b379e013c6 req-9a98451b-24d2-41e0-b455-e5785fc6f4f7 service nova] Acquired lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.network.neutron [req-7bf0decd-b667-4c13-97df-e6b379e013c6 req-9a98451b-24d2-41e0-b455-e5785fc6f4f7 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Refreshing network info cache for port 6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Start _get_guest_xml network_info=[{"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:49:55 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:49:55 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1517703466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1517703466',id=35,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQsx1ABdF1oDTTHl2dQ73XB30MjY84hupfzPAlDU7Hq+iafUfMvhxLO4Yt6zdhIuLdfyifLOZP35dbq9sYWgYcm/G9+mETkYtsf6WOEE/p8U3nu5Q7skPw4zfL5zH2xlA==',key_name='tempest-keypair-1401762589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-8k9aidcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=8377b22e-d359-47c3-bd2d-8b008b35a042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'pci_devices' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:49:55 user nova-compute[70914]:   <uuid>8377b22e-d359-47c3-bd2d-8b008b35a042</uuid>
Jul 27 13:49:55 user nova-compute[70914]:   <name>instance-00000023</name>
Jul 27 13:49:55 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:49:55 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:49:55 user nova-compute[70914]:   <metadata>
Jul 27 13:49:55 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:49:55 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:49:55 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1517703466</nova:name>
Jul 27 13:49:55 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:49:55</nova:creationTime>
Jul 27 13:49:55 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:49:55 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:49:55 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:49:55 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:49:55 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:49:55 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:49:55 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:49:55 user nova-compute[70914]:       <nova:owner>
Jul 27 13:49:55 user nova-compute[70914]:         <nova:user uuid="ce42c397b5d44afd9c12497b2bf40fb5">tempest-AttachVolumeShelveTestJSON-90363656-project-member</nova:user>
Jul 27 13:49:55 user nova-compute[70914]:         <nova:project uuid="30c132beeb2d43b1b568da4492f2ffc9">tempest-AttachVolumeShelveTestJSON-90363656</nova:project>
Jul 27 13:49:55 user nova-compute[70914]:       </nova:owner>
Jul 27 13:49:55 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:49:55 user nova-compute[70914]:       <nova:ports>
Jul 27 13:49:55 user nova-compute[70914]:         <nova:port uuid="6ce0387e-c296-41be-b5e6-9d5ab538cec8">
Jul 27 13:49:55 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 13:49:55 user nova-compute[70914]:         </nova:port>
Jul 27 13:49:55 user nova-compute[70914]:       </nova:ports>
Jul 27 13:49:55 user nova-compute[70914]:     </nova:instance>
Jul 27 13:49:55 user nova-compute[70914]:   </metadata>
Jul 27 13:49:55 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:49:55 user nova-compute[70914]:     <system>
Jul 27 13:49:55 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:49:55 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:49:55 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:49:55 user nova-compute[70914]:       <entry name="serial">8377b22e-d359-47c3-bd2d-8b008b35a042</entry>
Jul 27 13:49:55 user nova-compute[70914]:       <entry name="uuid">8377b22e-d359-47c3-bd2d-8b008b35a042</entry>
Jul 27 13:49:55 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:49:55 user nova-compute[70914]:     </system>
Jul 27 13:49:55 user nova-compute[70914]:   </sysinfo>
Jul 27 13:49:55 user nova-compute[70914]:   <os>
Jul 27 13:49:55 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:49:55 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:49:55 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:49:55 user nova-compute[70914]:   </os>
Jul 27 13:49:55 user nova-compute[70914]:   <features>
Jul 27 13:49:55 user nova-compute[70914]:     <acpi/>
Jul 27 13:49:55 user nova-compute[70914]:     <apic/>
Jul 27 13:49:55 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:49:55 user nova-compute[70914]:   </features>
Jul 27 13:49:55 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:49:55 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:49:55 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:49:55 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:49:55 user nova-compute[70914]:   </clock>
Jul 27 13:49:55 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:49:55 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:49:55 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:49:55 user nova-compute[70914]:   </cpu>
Jul 27 13:49:55 user nova-compute[70914]:   <devices>
Jul 27 13:49:55 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:49:55 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:49:55 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk"/>
Jul 27 13:49:55 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:49:55 user nova-compute[70914]:     </disk>
Jul 27 13:49:55 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:49:55 user nova-compute[70914]:       <mac address="fa:16:3e:f9:cf:c1"/>
Jul 27 13:49:55 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:49:55 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:49:55 user nova-compute[70914]:       <target dev="tap6ce0387e-c2"/>
Jul 27 13:49:55 user nova-compute[70914]:     </interface>
Jul 27 13:49:55 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:49:55 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/console.log" append="off"/>
Jul 27 13:49:55 user nova-compute[70914]:     </serial>
Jul 27 13:49:55 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:49:55 user nova-compute[70914]:     <video>
Jul 27 13:49:55 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:49:55 user nova-compute[70914]:     </video>
Jul 27 13:49:55 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:49:55 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:49:55 user nova-compute[70914]:     </rng>
Jul 27 13:49:55 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:49:55 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:49:55 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:49:55 user nova-compute[70914]:     </memballoon>
Jul 27 13:49:55 user nova-compute[70914]:   </devices>
Jul 27 13:49:55 user nova-compute[70914]: </domain>
Jul 27 13:49:55 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1517703466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1517703466',id=35,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQsx1ABdF1oDTTHl2dQ73XB30MjY84hupfzPAlDU7Hq+iafUfMvhxLO4Yt6zdhIuLdfyifLOZP35dbq9sYWgYcm/G9+mETkYtsf6WOEE/p8U3nu5Q7skPw4zfL5zH2xlA==',key_name='tempest-keypair-1401762589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-8k9aidcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=8377b22e-d359-47c3-bd2d-8b008b35a042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG os_vif [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ce0387e-c2, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ce0387e-c2, col_values=(('external_ids', {'iface-id': '6ce0387e-c296-41be-b5e6-9d5ab538cec8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:cf:c1', 'vm-uuid': '8377b22e-d359-47c3-bd2d-8b008b35a042'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:55 user nova-compute[70914]: INFO os_vif [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2')
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:49:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] No VIF found with MAC fa:16:3e:f9:cf:c1, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:49:56 user nova-compute[70914]: DEBUG nova.network.neutron [req-7bf0decd-b667-4c13-97df-e6b379e013c6 req-9a98451b-24d2-41e0-b455-e5785fc6f4f7 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updated VIF entry in instance network info cache for port 6ce0387e-c296-41be-b5e6-9d5ab538cec8. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:49:56 user nova-compute[70914]: DEBUG nova.network.neutron [req-7bf0decd-b667-4c13-97df-e6b379e013c6 req-9a98451b-24d2-41e0-b455-e5785fc6f4f7 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updating instance_info_cache with network_info: [{"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:49:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7bf0decd-b667-4c13-97df-e6b379e013c6 req-9a98451b-24d2-41e0-b455-e5785fc6f4f7 service nova] Releasing lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:49:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-12f18257-5ca3-4a7b-a5ab-967065e50957 req-9196518f-bb9e-48c5-b767-2133a07734d3 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received event network-changed-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-12f18257-5ca3-4a7b-a5ab-967065e50957 req-9196518f-bb9e-48c5-b767-2133a07734d3 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Refreshing instance network info cache due to event network-changed-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:49:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-12f18257-5ca3-4a7b-a5ab-967065e50957 req-9196518f-bb9e-48c5-b767-2133a07734d3 service nova] Acquiring lock "refresh_cache-e57eb314-e8bc-42ce-b972-88dff36a0fef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:49:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-12f18257-5ca3-4a7b-a5ab-967065e50957 req-9196518f-bb9e-48c5-b767-2133a07734d3 service nova] Acquired lock "refresh_cache-e57eb314-e8bc-42ce-b972-88dff36a0fef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:49:56 user nova-compute[70914]: DEBUG nova.network.neutron [req-12f18257-5ca3-4a7b-a5ab-967065e50957 req-9196518f-bb9e-48c5-b767-2133a07734d3 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Refreshing network info cache for port 4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:49:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:57 user nova-compute[70914]: DEBUG nova.network.neutron [req-12f18257-5ca3-4a7b-a5ab-967065e50957 req-9196518f-bb9e-48c5-b767-2133a07734d3 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Updated VIF entry in instance network info cache for port 4665ab9b-5f56-4c14-b20f-245d7e7c4a1f. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:49:57 user nova-compute[70914]: DEBUG nova.network.neutron [req-12f18257-5ca3-4a7b-a5ab-967065e50957 req-9196518f-bb9e-48c5-b767-2133a07734d3 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Updating instance_info_cache with network_info: [{"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:49:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-12f18257-5ca3-4a7b-a5ab-967065e50957 req-9196518f-bb9e-48c5-b767-2133a07734d3 service nova] Releasing lock "refresh_cache-e57eb314-e8bc-42ce-b972-88dff36a0fef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:49:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] No waiting events found dispatching network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:49:58 user nova-compute[70914]: WARNING nova.compute.manager [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received unexpected event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 for instance with vm_state building and task_state spawning.
Jul 27 13:49:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:49:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:49:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:49:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:49:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] No waiting events found dispatching network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:49:58 user nova-compute[70914]: WARNING nova.compute.manager [req-c1845706-4de9-4e44-8ba8-1c763c999db6 req-330c2fb0-3cc6-4afa-b50c-f75c45b3ed55 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received unexpected event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 for instance with vm_state building and task_state spawning.
Jul 27 13:49:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465799.4852414, 8377b22e-d359-47c3-bd2d-8b008b35a042 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:49:59 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] VM Resumed (Lifecycle Event)
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:49:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance spawned successfully.
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:49:59 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465799.4867089, 8377b22e-d359-47c3-bd2d-8b008b35a042 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:49:59 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] VM Started (Lifecycle Event)
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:49:59 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:49:59 user nova-compute[70914]: INFO nova.compute.manager [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Took 5.71 seconds to spawn the instance on the hypervisor.
Jul 27 13:49:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:49:59 user nova-compute[70914]: INFO nova.compute.manager [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Took 6.49 seconds to build instance.
Jul 27 13:49:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-47358675-7caa-4d19-b7ce-f933b0ab673d tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.591s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG nova.objects.instance [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lazy-loading 'flavor' on Instance uuid e57eb314-e8bc-42ce-b972-88dff36a0fef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:01 user nova-compute[70914]: INFO nova.compute.manager [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Attaching volume 7052504c-65aa-4e2f-af46-a39b12eada25 to /dev/vdb
Jul 27 13:50:01 user nova-compute[70914]: DEBUG os_brick.utils [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5131e7-45cd-4db6-b6c6-1b52310df112]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e3f0c6-9177-4cac-aab9-9507695adc24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff83067-222c-4e64-8fa0-287e4e5b33b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf222985-a631-4698-9e45-52a7180b8a6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:50:01 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:50:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8267c4d2-5638-44d1-b33f-3b01f2532a5e]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG os_brick.utils [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:50:01 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Updating existing volume attachment record: 972fac43-0faf-40ae-aa75-42e3dcdc0850 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:50:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmVdvIFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:50:08 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:50:08 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:50:08 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fe495b-a9fc-427c-89da-a6cf04d4ba73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:50:08 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[267adfb8-8ee9-41a4-92c0-d7857a772b41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25] added
Jul 27 13:50:08 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3c1100-b8e1-4ffb-a242-5d8d247dfd55]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cc72dd-5d78-4d72-9591-c28c0c08d516]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmVdvIFC {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmVdvIFC" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5da26b8-2b56-4116-8153-08cbf1cc51e4]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UmVdvIFC'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7190bc47-c9bf-4756-bb32-05a477dedaba]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee97dbff-f979-4f3f-a89a-258c718f501d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:50:09 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:50:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:50:09 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:50:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2971e0-ef67-478e-847b-be135aa3b623]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25, portal: 172.16.0.220,3260]
Jul 27 13:50:09 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25, portal: 172.16.0.220,3260] successful.
Jul 27 13:50:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb8fc85-8697-46b6-918b-61104f4c4923]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3762b0d5-b6c1-420a-ae3f-70132819709a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:50:09 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:50:09 user nova-compute[70914]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 (non-flash)
Jul 27 13:50:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:50:09 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:50:09 user nova-compute[70914]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 (non-flash)
Jul 27 13:50:09 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb6e71-4379-46d3-9d88-8ff69e3686fa]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:50:09 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmVdvIFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:50:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:50:10 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26535353366393464', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:50:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535353366393464', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:50:10 user nova-compute[70914]: DEBUG nova.objects.instance [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lazy-loading 'flavor' on Instance uuid e57eb314-e8bc-42ce-b972-88dff36a0fef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:50:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:50:10 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:50:10 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:50:10 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:50:10 user nova-compute[70914]:   <serial>7052504c-65aa-4e2f-af46-a39b12eada25</serial>
Jul 27 13:50:10 user nova-compute[70914]: </disk>
Jul 27 13:50:10 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:50:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:50:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:50:10 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] No VIF found with MAC fa:16:3e:14:0f:19, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:50:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-bf710c5d-eb91-4577-ae7b-19251933fbd2 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.293s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:50:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:12 user nova-compute[70914]: INFO nova.compute.manager [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Detaching volume 7052504c-65aa-4e2f-af46-a39b12eada25
Jul 27 13:50:12 user nova-compute[70914]: INFO nova.virt.block_device [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Attempting to driver detach volume 7052504c-65aa-4e2f-af46-a39b12eada25 from mountpoint /dev/vdb
Jul 27 13:50:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Attempting to detach device vdb from instance e57eb314-e8bc-42ce-b972-88dff36a0fef from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:50:13 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:50:13 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:50:13 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:50:13 user nova-compute[70914]:   <serial>7052504c-65aa-4e2f-af46-a39b12eada25</serial>
Jul 27 13:50:13 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:50:13 user nova-compute[70914]: </disk>
Jul 27 13:50:13 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:50:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Successfully detached device vdb from instance e57eb314-e8bc-42ce-b972-88dff36a0fef from the persistent domain config.
Jul 27 13:50:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e57eb314-e8bc-42ce-b972-88dff36a0fef from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:50:13 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:50:13 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:50:13 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:50:13 user nova-compute[70914]:   <serial>7052504c-65aa-4e2f-af46-a39b12eada25</serial>
Jul 27 13:50:13 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:50:13 user nova-compute[70914]: </disk>
Jul 27 13:50:13 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465813.4551003, e57eb314-e8bc-42ce-b972-88dff36a0fef => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e57eb314-e8bc-42ce-b972-88dff36a0fef {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:50:13 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Successfully detached device vdb from instance e57eb314-e8bc-42ce-b972-88dff36a0fef from the live domain config.
Jul 27 13:50:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmVdvIFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:50:13 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c81162-a374-4279-9fb9-2b43230f9779]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:50:13 user nova-compute[70914]: No targets found.
Jul 27 13:50:13 user nova-compute[70914]: iSNS:
Jul 27 13:50:13 user nova-compute[70914]: No targets found.
Jul 27 13:50:13 user nova-compute[70914]: STATIC:
Jul 27 13:50:13 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:50:13 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:50:13 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:50:13 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25
Jul 27 13:50:13 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:50:13 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:50:13 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3
Jul 27 13:50:13 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:50:13 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:50:13 user nova-compute[70914]: FIRMWARE:
Jul 27 13:50:13 user nova-compute[70914]: No targets found.
Jul 27 13:50:13 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:50:13 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:50:13 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce89e276-410f-4981-a572-0182874e8cd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[170d7a69-f4eb-4e28-861b-47a6888c0245]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:50:13 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:50:13 user nova-compute[70914]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 (non-flash)
Jul 27 13:50:13 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:50:13 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:50:13 user nova-compute[70914]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 (non-flash)
Jul 27 13:50:13 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18425e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[608ac82f-3475-47d0-a10e-a20cff511027]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[885d17b0-edc8-4654-b969-c89a022d831b]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[645a7a9a-44c2-4aca-979e-0dac44c9379b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a57efa-8685-4957-bea4-7ee8a9e9a068]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[350a945e-7a6c-47a2-8c59-96fccfbac32e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aa80ac-492d-42b5-9b1e-211585a27ac3]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25, portal: 172.16.0.220,3260]
Jul 27 13:50:13 user nova-compute[70914]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25, portal: 172.16.0.220,3260] successful.
Jul 27 13:50:13 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7052504c-65aa-4e2f-af46-a39b12eada25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae70349c-5a9d-4543-a279-0a072aa14518]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] <== disconnect_volume: return (317ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:50:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:50:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:14 user nova-compute[70914]: DEBUG nova.objects.instance [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lazy-loading 'flavor' on Instance uuid e57eb314-e8bc-42ce-b972-88dff36a0fef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:50:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-31e600cd-3b08-4144-b2b4-87c20b3afe07 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.663s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'flavor' on Instance uuid 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:32 user nova-compute[70914]: INFO nova.compute.manager [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Attaching volume e858d583-9cb1-476e-aff1-d8fca78eb49e to /dev/vdb
Jul 27 13:50:32 user nova-compute[70914]: DEBUG os_brick.utils [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f2992c-3c63-4776-acb7-902e3c6459b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b2df34-9dd3-4899-8f06-c3585a6da2b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c2877e-bd8c-4c14-b2a0-a4b7b57345dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2b3136-14e8-4b01-a377-72bbf57e49bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:50:32 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:50:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[583c8e59-5469-4392-961a-8a4ebb8cddca]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG os_brick.utils [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:50:32 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updating existing volume attachment record: 89e29cb5-a939-4ab5-9941-17934b132bcb {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:50:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:50:38 user nova-compute[70914]: INFO nova.compute.manager [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] instance snapshotting
Jul 27 13:50:38 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Beginning live snapshot process
Jul 27 13:50:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json -f qcow2 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json -f qcow2 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvkutszuy/04285e6b55e942d39f430b30491448b9.delta 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvkutszuy/04285e6b55e942d39f430b30491448b9.delta 1073741824" returned: 0 in 0.052s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 13:50:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJBxjRGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:50:39 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:50:39 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:50:39 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b810ba-45ea-4c37-ae54-d01cacb5e59d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:50:39 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4c8f3d-dc8a-417f-a0aa-9bf08b9b8e40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e] added
Jul 27 13:50:39 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68aa40d-d42c-4e05-8f26-0a5351e72dec]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06d003c-3c97-45f9-a154-4e6fc754aa14]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NJBxjRGc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NJBxjRGc" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5bb1a6-56fe-4620-9fcc-db9a9b28fe62]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NJBxjRGc'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[028b7c38-f0d7-469e-a269-1ae388469930]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c56027-9911-4c76-8656-433f16efe870]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:50:39 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:50:39 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:50:39 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:50:39 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53de7e3-0f1d-44ff-8bb7-558716626b48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e, portal: 172.16.0.220,3260]
Jul 27 13:50:39 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e, portal: 172.16.0.220,3260] successful.
Jul 27 13:50:39 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca16bd82-1cbc-49dc-800d-598fcd68abed]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:50:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb125e1-299c-412b-8a8d-fc42868dc5a5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:50:40 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:50:40 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:50:40 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:50:40 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:50:40 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:50:40 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13c9d32-961b-4df7-8d14-bd132e34e761]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJBxjRGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 13:50:40 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 13:50:40 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvkutszuy/04285e6b55e942d39f430b30491448b9.delta /opt/stack/data/nova/instances/snapshots/tmpvkutszuy/04285e6b55e942d39f430b30491448b9 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvkutszuy/04285e6b55e942d39f430b30491448b9.delta /opt/stack/data/nova/instances/snapshots/tmpvkutszuy/04285e6b55e942d39f430b30491448b9" returned: 0 in 0.330s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:40 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Snapshot extracted, beginning image upload
Jul 27 13:50:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:50:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23565316633346362', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:50:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565316633346362', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:50:41 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'flavor' on Instance uuid 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:50:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:50:41 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:50:41 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:50:41 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:50:41 user nova-compute[70914]:   <serial>e858d583-9cb1-476e-aff1-d8fca78eb49e</serial>
Jul 27 13:50:41 user nova-compute[70914]: </disk>
Jul 27 13:50:41 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:50:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:50:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:50:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] No VIF found with MAC fa:16:3e:ca:16:bb, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:50:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7a29896d-69a0-4660-b31a-4789da7baee8 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.581s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:43 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Snapshot image upload complete
Jul 27 13:50:43 user nova-compute[70914]: INFO nova.compute.manager [None req-75ab56b2-1e92-4810-b9ea-adfd9a710e5f tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Took 5.20 seconds to snapshot the instance on the hypervisor.
Jul 27 13:50:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-7e712524-ec69-4026-b7bb-2737d77ecd6d req-945079de-b8ba-4894-acc3-c6e36f92eefb service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-changed-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:50:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-7e712524-ec69-4026-b7bb-2737d77ecd6d req-945079de-b8ba-4894-acc3-c6e36f92eefb service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Refreshing instance network info cache due to event network-changed-579d72f4-5dd4-4666-9beb-2ca8049b1475. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:50:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7e712524-ec69-4026-b7bb-2737d77ecd6d req-945079de-b8ba-4894-acc3-c6e36f92eefb service nova] Acquiring lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:50:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7e712524-ec69-4026-b7bb-2737d77ecd6d req-945079de-b8ba-4894-acc3-c6e36f92eefb service nova] Acquired lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:50:44 user nova-compute[70914]: DEBUG nova.network.neutron [req-7e712524-ec69-4026-b7bb-2737d77ecd6d req-945079de-b8ba-4894-acc3-c6e36f92eefb service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Refreshing network info cache for port 579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:50:45 user nova-compute[70914]: DEBUG nova.network.neutron [req-7e712524-ec69-4026-b7bb-2737d77ecd6d req-945079de-b8ba-4894-acc3-c6e36f92eefb service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updated VIF entry in instance network info cache for port 579d72f4-5dd4-4666-9beb-2ca8049b1475. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:50:45 user nova-compute[70914]: DEBUG nova.network.neutron [req-7e712524-ec69-4026-b7bb-2737d77ecd6d req-945079de-b8ba-4894-acc3-c6e36f92eefb service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updating instance_info_cache with network_info: [{"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:50:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7e712524-ec69-4026-b7bb-2737d77ecd6d req-945079de-b8ba-4894-acc3-c6e36f92eefb service nova] Releasing lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:50:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:50:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:50:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:50:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:50:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-217e38be-0a80-4a60-b090-b60f72f05750 req-c2af4048-9d19-458a-bc9c-7213606dfb9e service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-changed-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:50:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-217e38be-0a80-4a60-b090-b60f72f05750 req-c2af4048-9d19-458a-bc9c-7213606dfb9e service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Refreshing instance network info cache due to event network-changed-579d72f4-5dd4-4666-9beb-2ca8049b1475. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:50:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-217e38be-0a80-4a60-b090-b60f72f05750 req-c2af4048-9d19-458a-bc9c-7213606dfb9e service nova] Acquiring lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:50:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-217e38be-0a80-4a60-b090-b60f72f05750 req-c2af4048-9d19-458a-bc9c-7213606dfb9e service nova] Acquired lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:50:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-217e38be-0a80-4a60-b090-b60f72f05750 req-c2af4048-9d19-458a-bc9c-7213606dfb9e service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Refreshing network info cache for port 579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:50:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:47 user nova-compute[70914]: INFO nova.compute.manager [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Rebooting instance
Jul 27 13:50:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:50:47 user nova-compute[70914]: DEBUG nova.network.neutron [req-217e38be-0a80-4a60-b090-b60f72f05750 req-c2af4048-9d19-458a-bc9c-7213606dfb9e service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updated VIF entry in instance network info cache for port 579d72f4-5dd4-4666-9beb-2ca8049b1475. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:50:47 user nova-compute[70914]: DEBUG nova.network.neutron [req-217e38be-0a80-4a60-b090-b60f72f05750 req-c2af4048-9d19-458a-bc9c-7213606dfb9e service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updating instance_info_cache with network_info: [{"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:50:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-217e38be-0a80-4a60-b090-b60f72f05750 req-c2af4048-9d19-458a-bc9c-7213606dfb9e service nova] Releasing lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:50:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquired lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:50:47 user nova-compute[70914]: DEBUG nova.network.neutron [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:50:47 user nova-compute[70914]: DEBUG nova.network.neutron [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updating instance_info_cache with network_info: [{"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:50:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Releasing lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:50:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:50:48 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-6f7765a3-81f6-4978-8303-291c8cb2b992 req-affb61b6-67e7-40ca-ad57-28814e5f3bde service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-vif-unplugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6f7765a3-81f6-4978-8303-291c8cb2b992 req-affb61b6-67e7-40ca-ad57-28814e5f3bde service nova] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6f7765a3-81f6-4978-8303-291c8cb2b992 req-affb61b6-67e7-40ca-ad57-28814e5f3bde service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6f7765a3-81f6-4978-8303-291c8cb2b992 req-affb61b6-67e7-40ca-ad57-28814e5f3bde service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-6f7765a3-81f6-4978-8303-291c8cb2b992 req-affb61b6-67e7-40ca-ad57-28814e5f3bde service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] No waiting events found dispatching network-vif-unplugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:50:50 user nova-compute[70914]: WARNING nova.compute.manager [req-6f7765a3-81f6-4978-8303-291c8cb2b992 req-affb61b6-67e7-40ca-ad57-28814e5f3bde service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received unexpected event network-vif-unplugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 for instance with vm_state active and task_state reboot_started.
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:50 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Instance shutdown successfully.
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:50:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-25bea5e2-a1d7-42ed-93dc-7d5c67d3d2b9 req-a2d0fd06-2d97-405c-8216-20f28be5e8bc service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-25bea5e2-a1d7-42ed-93dc-7d5c67d3d2b9 req-a2d0fd06-2d97-405c-8216-20f28be5e8bc service nova] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-25bea5e2-a1d7-42ed-93dc-7d5c67d3d2b9 req-a2d0fd06-2d97-405c-8216-20f28be5e8bc service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-25bea5e2-a1d7-42ed-93dc-7d5c67d3d2b9 req-a2d0fd06-2d97-405c-8216-20f28be5e8bc service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-25bea5e2-a1d7-42ed-93dc-7d5c67d3d2b9 req-a2d0fd06-2d97-405c-8216-20f28be5e8bc service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] No waiting events found dispatching network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:50:52 user nova-compute[70914]: WARNING nova.compute.manager [req-25bea5e2-a1d7-42ed-93dc-7d5c67d3d2b9 req-a2d0fd06-2d97-405c-8216-20f28be5e8bc service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received unexpected event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 for instance with vm_state active and task_state reboot_started.
Jul 27 13:50:52 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:50:52 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7634MB free_disk=25.169849395751953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3b8cffe7-b0ad-487b-8229-54469afefdd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e57eb314-e8bc-42ce-b972-88dff36a0fef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cd4b9913-ab18-42d7-abd7-c4dad48375c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e203cf51-97bf-4fc7-aa94-3a604c862abd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8377b22e-d359-47c3-bd2d-8b008b35a042 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:50:52 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:50:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:50:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465854.359765, 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:50:54 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] VM Resumed (Lifecycle Event)
Jul 27 13:50:54 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Instance running successfully.
Jul 27 13:50:54 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Instance soft rebooted successfully.
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:50:54 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465854.3618147, 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:50:54 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] VM Started (Lifecycle Event)
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-07458130-11fd-449a-a66a-cece16271086 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.182s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] No waiting events found dispatching network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:50:54 user nova-compute[70914]: WARNING nova.compute.manager [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received unexpected event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 for instance with vm_state active and task_state None.
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] No waiting events found dispatching network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:50:54 user nova-compute[70914]: WARNING nova.compute.manager [req-cdb0e368-eb33-4fbf-9aa5-d48537069acb req-652c6af1-0b21-4832-9e9c-ef3dffdd94f8 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received unexpected event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 for instance with vm_state active and task_state None.
Jul 27 13:50:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:50:55 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:50:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:50:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 13:50:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:50:56 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:50:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:51:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:51:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:51:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:51:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:08 user nova-compute[70914]: INFO nova.compute.manager [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Terminating instance
Jul 27 13:51:08 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:51:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-d9bdcec5-fdc0-4fb0-9d99-3217ae0702a9 req-0b5adad7-93f3-41b4-b9df-c54ecf1a0dc2 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received event network-vif-unplugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d9bdcec5-fdc0-4fb0-9d99-3217ae0702a9 req-0b5adad7-93f3-41b4-b9df-c54ecf1a0dc2 service nova] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d9bdcec5-fdc0-4fb0-9d99-3217ae0702a9 req-0b5adad7-93f3-41b4-b9df-c54ecf1a0dc2 service nova] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d9bdcec5-fdc0-4fb0-9d99-3217ae0702a9 req-0b5adad7-93f3-41b4-b9df-c54ecf1a0dc2 service nova] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-d9bdcec5-fdc0-4fb0-9d99-3217ae0702a9 req-0b5adad7-93f3-41b4-b9df-c54ecf1a0dc2 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] No waiting events found dispatching network-vif-unplugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-d9bdcec5-fdc0-4fb0-9d99-3217ae0702a9 req-0b5adad7-93f3-41b4-b9df-c54ecf1a0dc2 service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received event network-vif-unplugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Instance destroyed successfully.
Jul 27 13:51:09 user nova-compute[70914]: DEBUG nova.objects.instance [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lazy-loading 'resources' on Instance uuid e57eb314-e8bc-42ce-b972-88dff36a0fef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-303978480',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-303978480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3039784',id=31,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/i2v2lJMrrneI+OeJ1OPL65VGyr16rzvbaq55qcp+BeT8d+fAHIpAop/uZZmXl1De/bRbl+QphwemASuMOAWXBRTmogS+JKGbtQ/CoAjgDc0UyAkLgiRXyUuOY0JI9yA==',key_name='tempest-keypair-992062845',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:48:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c9d39303ca241749d982641d2a80b9c',ramdisk_id='',reservation_id='r-cljavh05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837299822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:48:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ed7ab38fa444d7b552d698c1266b4a',uuid=e57eb314-e8bc-42ce-b972-88dff36a0fef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Converting VIF {"id": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "address": "fa:16:3e:14:0f:19", "network": {"id": "892bcd79-a67c-4384-8838-d791a24e8e4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-295273611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9d39303ca241749d982641d2a80b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4665ab9b-5f", "ovs_interfaceid": "4665ab9b-5f56-4c14-b20f-245d7e7c4a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:0f:19,bridge_name='br-int',has_traffic_filtering=True,id=4665ab9b-5f56-4c14-b20f-245d7e7c4a1f,network=Network(892bcd79-a67c-4384-8838-d791a24e8e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4665ab9b-5f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG os_vif [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:0f:19,bridge_name='br-int',has_traffic_filtering=True,id=4665ab9b-5f56-4c14-b20f-245d7e7c4a1f,network=Network(892bcd79-a67c-4384-8838-d791a24e8e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4665ab9b-5f') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4665ab9b-5f, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:51:09 user nova-compute[70914]: INFO os_vif [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:0f:19,bridge_name='br-int',has_traffic_filtering=True,id=4665ab9b-5f56-4c14-b20f-245d7e7c4a1f,network=Network(892bcd79-a67c-4384-8838-d791a24e8e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4665ab9b-5f')
Jul 27 13:51:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Deleting instance files /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef_del
Jul 27 13:51:09 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Deletion of /opt/stack/data/nova/instances/e57eb314-e8bc-42ce-b972-88dff36a0fef_del complete
Jul 27 13:51:09 user nova-compute[70914]: INFO nova.compute.manager [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 27 13:51:09 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:51:09 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:51:10 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:51:10 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Took 1.04 seconds to deallocate network for instance.
Jul 27 13:51:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-ade26ae9-9ddc-46ea-963a-5561585b9f41 req-202faa2c-00d9-46ba-bdee-43b8bf1ea40d service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received event network-vif-deleted-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:51:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:11 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:51:11 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:51:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:11 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Deleted allocations for instance e57eb314-e8bc-42ce-b972-88dff36a0fef
Jul 27 13:51:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-2d1d6709-cb06-4d07-ada2-b5ade74c1231 req-7ab22557-2207-44aa-88ea-aa6f5e5f6dbd service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received event network-vif-plugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:51:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2d1d6709-cb06-4d07-ada2-b5ade74c1231 req-7ab22557-2207-44aa-88ea-aa6f5e5f6dbd service nova] Acquiring lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2d1d6709-cb06-4d07-ada2-b5ade74c1231 req-7ab22557-2207-44aa-88ea-aa6f5e5f6dbd service nova] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2d1d6709-cb06-4d07-ada2-b5ade74c1231 req-7ab22557-2207-44aa-88ea-aa6f5e5f6dbd service nova] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-2d1d6709-cb06-4d07-ada2-b5ade74c1231 req-7ab22557-2207-44aa-88ea-aa6f5e5f6dbd service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] No waiting events found dispatching network-vif-plugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:51:11 user nova-compute[70914]: WARNING nova.compute.manager [req-2d1d6709-cb06-4d07-ada2-b5ade74c1231 req-7ab22557-2207-44aa-88ea-aa6f5e5f6dbd service nova] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Received unexpected event network-vif-plugged-4665ab9b-5f56-4c14-b20f-245d7e7c4a1f for instance with vm_state deleted and task_state None.
Jul 27 13:51:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e016c397-5875-4f78-92b8-72a8db7ebba4 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822 tempest-TestServerVolumeAttachScenarioOldVersion-1837299822-project-member] Lock "e57eb314-e8bc-42ce-b972-88dff36a0fef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.508s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-966d4450-d79a-4ad2-b414-52fd860ab6d3 req-933c12c5-b280-41df-9ad4-ee64858788b9 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received event network-changed-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:51:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-966d4450-d79a-4ad2-b414-52fd860ab6d3 req-933c12c5-b280-41df-9ad4-ee64858788b9 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Refreshing instance network info cache due to event network-changed-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:51:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-966d4450-d79a-4ad2-b414-52fd860ab6d3 req-933c12c5-b280-41df-9ad4-ee64858788b9 service nova] Acquiring lock "refresh_cache-e203cf51-97bf-4fc7-aa94-3a604c862abd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:51:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-966d4450-d79a-4ad2-b414-52fd860ab6d3 req-933c12c5-b280-41df-9ad4-ee64858788b9 service nova] Acquired lock "refresh_cache-e203cf51-97bf-4fc7-aa94-3a604c862abd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:51:21 user nova-compute[70914]: DEBUG nova.network.neutron [req-966d4450-d79a-4ad2-b414-52fd860ab6d3 req-933c12c5-b280-41df-9ad4-ee64858788b9 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Refreshing network info cache for port b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:51:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:21 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'flavor' on Instance uuid e203cf51-97bf-4fc7-aa94-3a604c862abd {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:51:21 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Ignoring supplied device name: /dev/vdb
Jul 27 13:51:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG nova.network.neutron [req-966d4450-d79a-4ad2-b414-52fd860ab6d3 req-933c12c5-b280-41df-9ad4-ee64858788b9 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Updated VIF entry in instance network info cache for port b3038fab-e57c-42fa-94da-f8aaf1a3fd3d. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG nova.network.neutron [req-966d4450-d79a-4ad2-b414-52fd860ab6d3 req-933c12c5-b280-41df-9ad4-ee64858788b9 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Updating instance_info_cache with network_info: [{"id": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "address": "fa:16:3e:f8:a5:1f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3038fab-e5", "ovs_interfaceid": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:22 user nova-compute[70914]: INFO nova.compute.manager [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Attaching volume c7e2e479-e69f-48a3-accc-06ad2c9053ae to /dev/vdb
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-966d4450-d79a-4ad2-b414-52fd860ab6d3 req-933c12c5-b280-41df-9ad4-ee64858788b9 service nova] Releasing lock "refresh_cache-e203cf51-97bf-4fc7-aa94-3a604c862abd" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG os_brick.utils [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f48d51-86a6-4d68-bf65-dad2c0fdb52a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff573608-e164-4de8-9c72-40ae05ea302f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[05521608-18e5-4575-b21a-5db642fdbcd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe472864-9606-43fc-8c9d-3137a012f98e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:51:22 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:51:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c04f66-71e6-4f03-8843-51719360dff1]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG os_brick.utils [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:51:22 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Updating existing volume attachment record: 37840e5c-8d76-4612-975b-0f0e4f0b0438 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:51:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:24 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465869.50301, e57eb314-e8bc-42ce-b972-88dff36a0fef => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:51:24 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] VM Stopped (Lifecycle Event)
Jul 27 13:51:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-7c9d20df-887d-4de3-b331-d7020e731cc8 None None] [instance: e57eb314-e8bc-42ce-b972-88dff36a0fef] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:51:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHFbBEmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:51:29 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:51:29 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:51:29 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65e31c4-0cd1-472e-94df-d870dd9b1b7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:51:29 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16a2cd7-3dba-4b4b-a068-1664f2d4e5c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae] added
Jul 27 13:51:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e863f-8d42-4d1b-8439-b9bfc08bfc18]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1188e698-d4af-402e-8a8b-49fc2713c3f2]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHFbBEmD {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHFbBEmD" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[436e6c8f-648e-4698-b47c-a71e097cf170]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHFbBEmD'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b29b681-1d84-4500-91c2-934fc973fc53]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[846b698b-9c7f-4476-a351-af642bcc871a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:51:29 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:51:29 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:51:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:51:29 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:51:29 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:51:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50ef48a-6e59-42c2-8e55-f32edb3843dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae, portal: 172.16.0.220,3260]
Jul 27 13:51:29 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae, portal: 172.16.0.220,3260] successful.
Jul 27 13:51:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf18b8c-f259-472f-9132-d0d4543a8be8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[57868cd4-1244-4a83-9673-817c8f05182c]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:51:29 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:51:29 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:51:29 user nova-compute[70914]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)
Jul 27 13:51:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:51:29 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:51:29 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:51:29 user nova-compute[70914]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)
Jul 27 13:51:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b61e785-6220-4fcd-b18c-d2a3e6191262]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:51:30 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:51:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHFbBEmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:51:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:51:30 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23364623462396636', 'path': '/dev/sde'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:51:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364623462396636', 'path': '/dev/sde'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:51:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'flavor' on Instance uuid e203cf51-97bf-4fc7-aa94-3a604c862abd {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:51:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:51:30 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:51:30 user nova-compute[70914]:   <source dev="/dev/sde"/>
Jul 27 13:51:30 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:51:30 user nova-compute[70914]:   <serial>c7e2e479-e69f-48a3-accc-06ad2c9053ae</serial>
Jul 27 13:51:30 user nova-compute[70914]: </disk>
Jul 27 13:51:30 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:51:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:51:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:51:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] No VIF found with MAC fa:16:3e:f8:a5:1f, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:51:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-7b9fbc64-0b7f-4cc0-ad09-f0ef64e102ac tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.257s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:51:35 user nova-compute[70914]: INFO nova.compute.manager [None req-042d9e64-e22c-47fe-8c75-634aba7e30e0 tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Get console output
Jul 27 13:51:35 user nova-compute[70914]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 27 13:51:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-47ec5b7d-051f-4e30-9473-5bc24c947f57 req-90a7a82a-dd23-4d06-8649-cb7fd688f351 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-changed-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:51:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-47ec5b7d-051f-4e30-9473-5bc24c947f57 req-90a7a82a-dd23-4d06-8649-cb7fd688f351 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Refreshing instance network info cache due to event network-changed-6ce0387e-c296-41be-b5e6-9d5ab538cec8. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:51:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-47ec5b7d-051f-4e30-9473-5bc24c947f57 req-90a7a82a-dd23-4d06-8649-cb7fd688f351 service nova] Acquiring lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:51:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-47ec5b7d-051f-4e30-9473-5bc24c947f57 req-90a7a82a-dd23-4d06-8649-cb7fd688f351 service nova] Acquired lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:51:44 user nova-compute[70914]: DEBUG nova.network.neutron [req-47ec5b7d-051f-4e30-9473-5bc24c947f57 req-90a7a82a-dd23-4d06-8649-cb7fd688f351 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Refreshing network info cache for port 6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:51:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:44 user nova-compute[70914]: DEBUG nova.network.neutron [req-47ec5b7d-051f-4e30-9473-5bc24c947f57 req-90a7a82a-dd23-4d06-8649-cb7fd688f351 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updated VIF entry in instance network info cache for port 6ce0387e-c296-41be-b5e6-9d5ab538cec8. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:51:44 user nova-compute[70914]: DEBUG nova.network.neutron [req-47ec5b7d-051f-4e30-9473-5bc24c947f57 req-90a7a82a-dd23-4d06-8649-cb7fd688f351 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updating instance_info_cache with network_info: [{"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:51:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-47ec5b7d-051f-4e30-9473-5bc24c947f57 req-90a7a82a-dd23-4d06-8649-cb7fd688f351 service nova] Releasing lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:51:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:51:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:46 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:51:46 user nova-compute[70914]: INFO nova.compute.claims [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Claim successful on node user
Jul 27 13:51:47 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:51:47 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:51:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:51:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:51:47 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:51:47 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:51:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:51:47 user nova-compute[70914]: DEBUG nova.policy [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89bc44e787074838ba46afd3f81262f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9647080d1194d60aeb390b127895474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:51:47 user nova-compute[70914]: INFO nova.virt.block_device [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Booting with volume-backed-image 33cbcfd9-c349-4c50-a3d9-7b9d8aca3776 at /dev/vda
Jul 27 13:51:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Successfully created port: 98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:51:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Successfully updated port: 98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:51:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:51:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquired lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:51:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:51:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-bc6dec99-0456-44a1-97bf-1a279a091240 req-b5ec0f1e-ce26-4837-8971-3edf093f07bb service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-changed-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:51:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-bc6dec99-0456-44a1-97bf-1a279a091240 req-b5ec0f1e-ce26-4837-8971-3edf093f07bb service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Refreshing instance network info cache due to event network-changed-98d96a87-1eef-4e20-beef-a4f9e31205f3. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:51:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bc6dec99-0456-44a1-97bf-1a279a091240 req-b5ec0f1e-ce26-4837-8971-3edf093f07bb service nova] Acquiring lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:51:48 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:49 user nova-compute[70914]: INFO nova.compute.manager [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Shelving
Jul 27 13:51:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG nova.network.neutron [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Updating instance_info_cache with network_info: [{"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Releasing lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Instance network_info: |[{"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bc6dec99-0456-44a1-97bf-1a279a091240 req-b5ec0f1e-ce26-4837-8971-3edf093f07bb service nova] Acquired lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG nova.network.neutron [req-bc6dec99-0456-44a1-97bf-1a279a091240 req-b5ec0f1e-ce26-4837-8971-3edf093f07bb service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Refreshing network info cache for port 98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-b70513ae-d0da-48b6-8ea0-589948f00307 req-eba4d01e-1d07-47b7-b2d5-00e92e76dae8 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-vif-unplugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b70513ae-d0da-48b6-8ea0-589948f00307 req-eba4d01e-1d07-47b7-b2d5-00e92e76dae8 service nova] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b70513ae-d0da-48b6-8ea0-589948f00307 req-eba4d01e-1d07-47b7-b2d5-00e92e76dae8 service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b70513ae-d0da-48b6-8ea0-589948f00307 req-eba4d01e-1d07-47b7-b2d5-00e92e76dae8 service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG nova.compute.manager [req-b70513ae-d0da-48b6-8ea0-589948f00307 req-eba4d01e-1d07-47b7-b2d5-00e92e76dae8 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] No waiting events found dispatching network-vif-unplugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:51:49 user nova-compute[70914]: WARNING nova.compute.manager [req-b70513ae-d0da-48b6-8ea0-589948f00307 req-eba4d01e-1d07-47b7-b2d5-00e92e76dae8 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received unexpected event network-vif-unplugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 for instance with vm_state active and task_state shelving.
Jul 27 13:51:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:51:49 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance destroyed successfully.
Jul 27 13:51:49 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Beginning cold snapshot process
Jul 27 13:51:49 user nova-compute[70914]: DEBUG nova.network.neutron [req-bc6dec99-0456-44a1-97bf-1a279a091240 req-b5ec0f1e-ce26-4837-8971-3edf093f07bb service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Updated VIF entry in instance network info cache for port 98d96a87-1eef-4e20-beef-a4f9e31205f3. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:51:49 user nova-compute[70914]: DEBUG nova.network.neutron [req-bc6dec99-0456-44a1-97bf-1a279a091240 req-b5ec0f1e-ce26-4837-8971-3edf093f07bb service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Updating instance_info_cache with network_info: [{"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:51:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bc6dec99-0456-44a1-97bf-1a279a091240 req-b5ec0f1e-ce26-4837-8971-3edf093f07bb service nova] Releasing lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:51:50 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:51:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk /opt/stack/data/nova/instances/snapshots/tmpp9erxte8/af33da95e0a04388ad094ac09500018d {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:50 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:51:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:50 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:51:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk /opt/stack/data/nova/instances/snapshots/tmpp9erxte8/af33da95e0a04388ad094ac09500018d" returned: 0 in 0.647s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:50 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Snapshot extracted, beginning image upload
Jul 27 13:51:50 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-d97f0b3d-d841-4c92-85fa-165bd83d9024 req-a861b1f1-8ef4-413b-90de-16f941b5663b service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d97f0b3d-d841-4c92-85fa-165bd83d9024 req-a861b1f1-8ef4-413b-90de-16f941b5663b service nova] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d97f0b3d-d841-4c92-85fa-165bd83d9024 req-a861b1f1-8ef4-413b-90de-16f941b5663b service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d97f0b3d-d841-4c92-85fa-165bd83d9024 req-a861b1f1-8ef4-413b-90de-16f941b5663b service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-d97f0b3d-d841-4c92-85fa-165bd83d9024 req-a861b1f1-8ef4-413b-90de-16f941b5663b service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] No waiting events found dispatching network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:51:51 user nova-compute[70914]: WARNING nova.compute.manager [req-d97f0b3d-d841-4c92-85fa-165bd83d9024 req-a861b1f1-8ef4-413b-90de-16f941b5663b service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received unexpected event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 for instance with vm_state active and task_state shelving_image_uploading.
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:53 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:51:53 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7898MB free_disk=25.13892364501953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG os_brick.utils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:53 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Snapshot image upload complete
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f3b419-fc72-4490-b251-e4ca2938bc55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b236ef3f-30b4-42ed-ab0f-229ee2c324eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[367fe14b-f392-4198-b37d-9a3d263f4068]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e68fa53-27b2-4b38-9bb8-10ca3cb09a1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3b8cffe7-b0ad-487b-8229-54469afefdd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cd4b9913-ab18-42d7-abd7-c4dad48375c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e203cf51-97bf-4fc7-aa94-3a604c862abd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8377b22e-d359-47c3-bd2d-8b008b35a042 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance fc2a646b-4612-44e3-b2c2-6c53fc65eef1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:51:53 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cdfc91-73cb-4513-b4d6-e70620a889fb]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG os_brick.utils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Updating existing volume attachment record: f4fbc5b8-5d07-4975-bb56-575d7611ec58 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:51:53 user nova-compute[70914]: INFO nova.compute.manager [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Shelve offloading
Jul 27 13:51:53 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance destroyed successfully.
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquired lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:51:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:54 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updating instance_info_cache with network_info: [{"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:51:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Releasing lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:51:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:51:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:51:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:51:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:51:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:51:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:55 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance destroyed successfully.
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'resources' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1517703466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1517703466',id=35,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQsx1ABdF1oDTTHl2dQ73XB30MjY84hupfzPAlDU7Hq+iafUfMvhxLO4Yt6zdhIuLdfyifLOZP35dbq9sYWgYcm/G9+mETkYtsf6WOEE/p8U3nu5Q7skPw4zfL5zH2xlA==',key_name='tempest-keypair-1401762589',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-8k9aidcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member',shelved_at='2023-07-27T13:51:53.433299',shelved_host='user',shelved_image_id='e3901ba8-6c1d-4585-8656-564c8feb3200'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:51:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=8377b22e-d359-47c3-bd2d-8b008b35a042,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG os_vif [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ce0387e-c2, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-13cbbe12-9706-4cdc-9d6c-0b3587985182 req-80cc8467-fbea-4f83-a5b4-360542abb396 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-changed-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-13cbbe12-9706-4cdc-9d6c-0b3587985182 req-80cc8467-fbea-4f83-a5b4-360542abb396 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Refreshing instance network info cache due to event network-changed-6ce0387e-c296-41be-b5e6-9d5ab538cec8. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-13cbbe12-9706-4cdc-9d6c-0b3587985182 req-80cc8467-fbea-4f83-a5b4-360542abb396 service nova] Acquiring lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-13cbbe12-9706-4cdc-9d6c-0b3587985182 req-80cc8467-fbea-4f83-a5b4-360542abb396 service nova] Acquired lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.network.neutron [req-13cbbe12-9706-4cdc-9d6c-0b3587985182 req-80cc8467-fbea-4f83-a5b4-360542abb396 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Refreshing network info cache for port 6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:51:55 user nova-compute[70914]: INFO os_vif [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2')
Jul 27 13:51:55 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Deleting instance files /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042_del
Jul 27 13:51:55 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Deletion of /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042_del complete
Jul 27 13:51:55 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Deleted allocations for instance 8377b22e-d359-47c3-bd2d-8b008b35a042
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'numa_topology' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Skipping network cache update for instance because it is Building. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.network.neutron [req-13cbbe12-9706-4cdc-9d6c-0b3587985182 req-80cc8467-fbea-4f83-a5b4-360542abb396 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updated VIF entry in instance network info cache for port 6ce0387e-c296-41be-b5e6-9d5ab538cec8. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.network.neutron [req-13cbbe12-9706-4cdc-9d6c-0b3587985182 req-80cc8467-fbea-4f83-a5b4-360542abb396 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updating instance_info_cache with network_info: [{"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-13cbbe12-9706-4cdc-9d6c-0b3587985182 req-80cc8467-fbea-4f83-a5b4-360542abb396 service nova] Releasing lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3885e94a-aef2-4a79-8d60-3a91547376f6 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.747s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:51:56 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updating instance_info_cache with network_info: [{"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:51:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-814e062c-85d1-486b-8c7e-9198fbfc5f63" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:51:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:51:56 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:51:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:51:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:00 user nova-compute[70914]: INFO nova.compute.manager [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Detaching volume c7e2e479-e69f-48a3-accc-06ad2c9053ae
Jul 27 13:52:00 user nova-compute[70914]: INFO nova.virt.block_device [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Attempting to driver detach volume c7e2e479-e69f-48a3-accc-06ad2c9053ae from mountpoint /dev/vdb
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Attempting to detach device vdb from instance e203cf51-97bf-4fc7-aa94-3a604c862abd from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:52:00 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:52:00 user nova-compute[70914]:   <source dev="/dev/sde"/>
Jul 27 13:52:00 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:52:00 user nova-compute[70914]:   <serial>c7e2e479-e69f-48a3-accc-06ad2c9053ae</serial>
Jul 27 13:52:00 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:52:00 user nova-compute[70914]: </disk>
Jul 27 13:52:00 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Successfully detached device vdb from instance e203cf51-97bf-4fc7-aa94-3a604c862abd from the persistent domain config.
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e203cf51-97bf-4fc7-aa94-3a604c862abd from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:52:00 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:52:00 user nova-compute[70914]:   <source dev="/dev/sde"/>
Jul 27 13:52:00 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:52:00 user nova-compute[70914]:   <serial>c7e2e479-e69f-48a3-accc-06ad2c9053ae</serial>
Jul 27 13:52:00 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:52:00 user nova-compute[70914]: </disk>
Jul 27 13:52:00 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:52:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Creating image(s)
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Ensure instance console log exists: /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Start _get_guest_xml network_info=[{"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'f4fbc5b8-5d07-4975-bb56-575d7611ec58', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYnvQLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc2a646b-4612-44e3-b2c2-6c53fc65eef1', 'attached_at': '', 'detached_at': '', 'volume_id': '593c0e00-4003-4fe6-abca-df81c661f0ac', 'serial': '593c0e00-4003-4fe6-abca-df81c661f0ac'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:52:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:52:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYnvQLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:52:00 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:52:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:52:00 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:52:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:52:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:52:00 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:52:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6744b0-79be-405a-98c2-41b531afe83a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:52:01 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca89e8c-d641-4753-887d-e6d114b8e9fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac] added
Jul 27 13:52:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce70f0e-9f07-4b45-97f9-c4364481f9af]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d184241b-e816-4e0c-a8b5-abe8878efea6]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYnvQLJm {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYnvQLJm" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0b977f-092c-43eb-9285-aec2e8ee7b9f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZYnvQLJm'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2add09-9328-4fff-bbdf-abc3b951e4a3]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee851cd4-2926-49e5-ab94-e565d13dda8d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)
Jul 27 13:52:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)
Jul 27 13:52:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e244678-3a23-4bd7-980f-631219779257]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac, portal: 172.16.0.220,3260]
Jul 27 13:52:01 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac, portal: 172.16.0.220,3260] successful.
Jul 27 13:52:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf00f5a-b9f5-4efd-9be8-9ea07c13f503]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[af06a84c-c940-4216-bbb2-c1ef09d53a6c]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:52:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)
Jul 27 13:52:01 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:52:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465921.3246903, e203cf51-97bf-4fc7-aa94-3a604c862abd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e203cf51-97bf-4fc7-aa94-3a604c862abd {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:01 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Successfully detached device vdb from instance e203cf51-97bf-4fc7-aa94-3a604c862abd from the live domain config.
Jul 27 13:52:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHFbBEmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:52:01 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7032a8-e32c-41f6-a529-d4a25f119894]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:52:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYnvQLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26531643431386566', 'path': '/dev/sdf'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531643431386566', 'path': '/dev/sdf'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.021s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-521589190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-521589190',id=36,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-rpv2cmmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:51:47Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=fc2a646b-4612-44e3-b2c2-6c53fc65eef1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:ed,bridge_name='br-int',has_traffic_filtering=True,id=98d96a87-1eef-4e20-beef-a4f9e31205f3,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d96a87-1e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2a646b-4612-44e3-b2c2-6c53fc65eef1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c6898a-a67a-47b4-8fea-f0736edae51b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:52:02 user nova-compute[70914]: No targets found.
Jul 27 13:52:02 user nova-compute[70914]: iSNS:
Jul 27 13:52:02 user nova-compute[70914]: No targets found.
Jul 27 13:52:02 user nova-compute[70914]: STATIC:
Jul 27 13:52:02 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:52:02 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:02 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:02 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3
Jul 27 13:52:02 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:02 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:02 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac
Jul 27 13:52:02 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:02 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:02 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e
Jul 27 13:52:02 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:02 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:02 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae
Jul 27 13:52:02 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:02 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:02 user nova-compute[70914]: FIRMWARE:
Jul 27 13:52:02 user nova-compute[70914]: No targets found.
Jul 27 13:52:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:52:02 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:52:02 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:52:02 user nova-compute[70914]:   <uuid>fc2a646b-4612-44e3-b2c2-6c53fc65eef1</uuid>
Jul 27 13:52:02 user nova-compute[70914]:   <name>instance-00000024</name>
Jul 27 13:52:02 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:52:02 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:52:02 user nova-compute[70914]:   <metadata>
Jul 27 13:52:02 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:52:02 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:52:02 user nova-compute[70914]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-521589190</nova:name>
Jul 27 13:52:02 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:52:00</nova:creationTime>
Jul 27 13:52:02 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:52:02 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:52:02 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:52:02 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:52:02 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:52:02 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:52:02 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:52:02 user nova-compute[70914]:       <nova:owner>
Jul 27 13:52:02 user nova-compute[70914]:         <nova:user uuid="89bc44e787074838ba46afd3f81262f0">tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member</nova:user>
Jul 27 13:52:02 user nova-compute[70914]:         <nova:project uuid="e9647080d1194d60aeb390b127895474">tempest-ServerBootFromVolumeStableRescueTest-853279030</nova:project>
Jul 27 13:52:02 user nova-compute[70914]:       </nova:owner>
Jul 27 13:52:02 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:52:02 user nova-compute[70914]:       <nova:ports>
Jul 27 13:52:02 user nova-compute[70914]:         <nova:port uuid="98d96a87-1eef-4e20-beef-a4f9e31205f3">
Jul 27 13:52:02 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 13:52:02 user nova-compute[70914]:         </nova:port>
Jul 27 13:52:02 user nova-compute[70914]:       </nova:ports>
Jul 27 13:52:02 user nova-compute[70914]:     </nova:instance>
Jul 27 13:52:02 user nova-compute[70914]:   </metadata>
Jul 27 13:52:02 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:52:02 user nova-compute[70914]:     <system>
Jul 27 13:52:02 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:52:02 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:52:02 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:52:02 user nova-compute[70914]:       <entry name="serial">fc2a646b-4612-44e3-b2c2-6c53fc65eef1</entry>
Jul 27 13:52:02 user nova-compute[70914]:       <entry name="uuid">fc2a646b-4612-44e3-b2c2-6c53fc65eef1</entry>
Jul 27 13:52:02 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:52:02 user nova-compute[70914]:     </system>
Jul 27 13:52:02 user nova-compute[70914]:   </sysinfo>
Jul 27 13:52:02 user nova-compute[70914]:   <os>
Jul 27 13:52:02 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:52:02 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:52:02 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:52:02 user nova-compute[70914]:   </os>
Jul 27 13:52:02 user nova-compute[70914]:   <features>
Jul 27 13:52:02 user nova-compute[70914]:     <acpi/>
Jul 27 13:52:02 user nova-compute[70914]:     <apic/>
Jul 27 13:52:02 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:52:02 user nova-compute[70914]:   </features>
Jul 27 13:52:02 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:52:02 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:52:02 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:52:02 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:52:02 user nova-compute[70914]:   </clock>
Jul 27 13:52:02 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:52:02 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:52:02 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:52:02 user nova-compute[70914]:   </cpu>
Jul 27 13:52:02 user nova-compute[70914]:   <devices>
Jul 27 13:52:02 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:52:02 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:52:02 user nova-compute[70914]:       <source dev="/dev/sdf"/>
Jul 27 13:52:02 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:52:02 user nova-compute[70914]:       <serial>593c0e00-4003-4fe6-abca-df81c661f0ac</serial>
Jul 27 13:52:02 user nova-compute[70914]:     </disk>
Jul 27 13:52:02 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:52:02 user nova-compute[70914]:       <mac address="fa:16:3e:2f:4f:ed"/>
Jul 27 13:52:02 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:52:02 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:52:02 user nova-compute[70914]:       <target dev="tap98d96a87-1e"/>
Jul 27 13:52:02 user nova-compute[70914]:     </interface>
Jul 27 13:52:02 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:52:02 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/console.log" append="off"/>
Jul 27 13:52:02 user nova-compute[70914]:     </serial>
Jul 27 13:52:02 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:52:02 user nova-compute[70914]:     <video>
Jul 27 13:52:02 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:52:02 user nova-compute[70914]:     </video>
Jul 27 13:52:02 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:52:02 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:52:02 user nova-compute[70914]:     </rng>
Jul 27 13:52:02 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:52:02 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:52:02 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:52:02 user nova-compute[70914]:     </memballoon>
Jul 27 13:52:02 user nova-compute[70914]:   </devices>
Jul 27 13:52:02 user nova-compute[70914]: </domain>
Jul 27 13:52:02 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-521589190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-521589190',id=36,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-rpv2cmmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:51:47Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=fc2a646b-4612-44e3-b2c2-6c53fc65eef1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:ed,bridge_name='br-int',has_traffic_filtering=True,id=98d96a87-1eef-4e20-beef-a4f9e31205f3,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d96a87-1e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_vif [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:ed,bridge_name='br-int',has_traffic_filtering=True,id=98d96a87-1eef-4e20-beef-a4f9e31205f3,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d96a87-1e') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01025c0-197a-4bcd-a949-7c45a48cee77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98d96a87-1e, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98d96a87-1e, col_values=(('external_ids', {'iface-id': '98d96a87-1eef-4e20-beef-a4f9e31205f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:4f:ed', 'vm-uuid': 'fc2a646b-4612-44e3-b2c2-6c53fc65eef1'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:02 user nova-compute[70914]: INFO os_vif [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:ed,bridge_name='br-int',has_traffic_filtering=True,id=98d96a87-1eef-4e20-beef-a4f9e31205f3,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d96a87-1e')
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dae22e-06a1-4d96-abd8-634b8cade155]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:02 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:52:02 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:02 user nova-compute[70914]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)
Jul 27 13:52:02 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:52:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:02 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:52:02 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:02 user nova-compute[70914]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae (non-flash)
Jul 27 13:52:02 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:52:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18171c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae'): ({'sde'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Removing single pathed devices sde {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa6fb5-31db-42e9-a401-643e600d4cff]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No VIF found with MAC fa:16:3e:2f:4f:ed, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a679d6-278d-4a10-9f73-bfd1dc05ecea]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Flushing IO for device /dev/sde {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c768a5-9bcc-451a-b6ea-4e55efd8a953]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[527a59f3-742d-4d34-b71c-1b9ce8793df7]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[270e3953-f15c-4d12-9025-abaa6c2f9020]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb44aec-763e-4214-b147-10be034705a5]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae, portal: 172.16.0.220,3260]
Jul 27 13:52:02 user nova-compute[70914]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae, portal: 172.16.0.220,3260] successful.
Jul 27 13:52:02 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.101s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e8a1e4-c1ac-4f8b-b52a-775cb964a89b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] <== disconnect_volume: return (1429ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:52:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG nova.objects.instance [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'flavor' on Instance uuid e203cf51-97bf-4fc7-aa94-3a604c862abd {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9a09d4f8-b655-47c7-8210-f4a1bf5fec0e tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.873s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.738s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:03 user nova-compute[70914]: INFO nova.compute.manager [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Terminating instance
Jul 27 13:52:03 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cadd9d5-240a-4bc1-8f91-4679e76496b5 req-15706722-89b3-426b-ae24-2ba791de7931 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received event network-vif-unplugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cadd9d5-240a-4bc1-8f91-4679e76496b5 req-15706722-89b3-426b-ae24-2ba791de7931 service nova] Acquiring lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cadd9d5-240a-4bc1-8f91-4679e76496b5 req-15706722-89b3-426b-ae24-2ba791de7931 service nova] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8cadd9d5-240a-4bc1-8f91-4679e76496b5 req-15706722-89b3-426b-ae24-2ba791de7931 service nova] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cadd9d5-240a-4bc1-8f91-4679e76496b5 req-15706722-89b3-426b-ae24-2ba791de7931 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] No waiting events found dispatching network-vif-unplugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:52:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-8cadd9d5-240a-4bc1-8f91-4679e76496b5 req-15706722-89b3-426b-ae24-2ba791de7931 service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received event network-vif-unplugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-8d98c58d-09bd-42c5-9c3d-5cc865d15c03 req-ddb1d40b-51ea-475e-bad2-f6686d23faa2 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8d98c58d-09bd-42c5-9c3d-5cc865d15c03 req-ddb1d40b-51ea-475e-bad2-f6686d23faa2 service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8d98c58d-09bd-42c5-9c3d-5cc865d15c03 req-ddb1d40b-51ea-475e-bad2-f6686d23faa2 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8d98c58d-09bd-42c5-9c3d-5cc865d15c03 req-ddb1d40b-51ea-475e-bad2-f6686d23faa2 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-8d98c58d-09bd-42c5-9c3d-5cc865d15c03 req-ddb1d40b-51ea-475e-bad2-f6686d23faa2 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:52:04 user nova-compute[70914]: WARNING nova.compute.manager [req-8d98c58d-09bd-42c5-9c3d-5cc865d15c03 req-ddb1d40b-51ea-475e-bad2-f6686d23faa2 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state building and task_state spawning.
Jul 27 13:52:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:04 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Instance destroyed successfully.
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lazy-loading 'resources' on Instance uuid e203cf51-97bf-4fc7-aa94-3a604c862abd {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:49:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1668108360',display_name='tempest-VolumesSnapshotTestJSON-instance-1668108360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1668108360',id=34,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnMqYjKNGmrC6z6D/LBZy6ziXHX9g8wCb4kr8i/pn6E1f1G2yijkMU99d4vhl+cL3XL+eVyo6Xu5sQNKn8eOkEf671IozyXRvcuFOTm68HTz2nQMaR9ajjXvmea9iY5QQ==',key_name='tempest-keypair-106311766',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82c2842f73314df7b38893d27acf46e0',ramdisk_id='',reservation_id='r-pebasj9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-277407372',owner_user_name='tempest-VolumesSnapshotTestJSON-277407372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0d5277a420b42bfb40dfc0196fea575',uuid=e203cf51-97bf-4fc7-aa94-3a604c862abd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "address": "fa:16:3e:f8:a5:1f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3038fab-e5", "ovs_interfaceid": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converting VIF {"id": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "address": "fa:16:3e:f8:a5:1f", "network": {"id": "35b899ff-7f56-488f-9265-b9111c8815f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563394555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82c2842f73314df7b38893d27acf46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3038fab-e5", "ovs_interfaceid": "b3038fab-e57c-42fa-94da-f8aaf1a3fd3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:a5:1f,bridge_name='br-int',has_traffic_filtering=True,id=b3038fab-e57c-42fa-94da-f8aaf1a3fd3d,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3038fab-e5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_vif [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:a5:1f,bridge_name='br-int',has_traffic_filtering=True,id=b3038fab-e57c-42fa-94da-f8aaf1a3fd3d,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3038fab-e5') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3038fab-e5, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:52:04 user nova-compute[70914]: INFO os_vif [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:a5:1f,bridge_name='br-int',has_traffic_filtering=True,id=b3038fab-e57c-42fa-94da-f8aaf1a3fd3d,network=Network(35b899ff-7f56-488f-9265-b9111c8815f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3038fab-e5')
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHFbBEmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:52:04 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e234022d-2310-402b-8281-c3deeaef3c57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:52:04 user nova-compute[70914]: No targets found.
Jul 27 13:52:04 user nova-compute[70914]: iSNS:
Jul 27 13:52:04 user nova-compute[70914]: No targets found.
Jul 27 13:52:04 user nova-compute[70914]: STATIC:
Jul 27 13:52:04 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:52:04 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:04 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:04 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3
Jul 27 13:52:04 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:04 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:04 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac
Jul 27 13:52:04 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:04 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:04 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e
Jul 27 13:52:04 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:04 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:04 user nova-compute[70914]: FIRMWARE:
Jul 27 13:52:04 user nova-compute[70914]: No targets found.
Jul 27 13:52:04 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:52:04 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:52:04 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e2e479-e69f-48a3-accc-06ad2c9053ae', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adb744e-834c-4895-9aa5-537ffa5a336e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca31fe0-bd31-45ec-b512-6b94f2c13d02]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:04 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:52:04 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:04 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:52:04 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:04 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:52:04 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:04 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:52:04 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c1819dc60>, {}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Disconnecting from: [] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] <== disconnect_volume: return (88ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:52:04 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Deleting instance files /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd_del
Jul 27 13:52:04 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Deletion of /opt/stack/data/nova/instances/e203cf51-97bf-4fc7-aa94-3a604c862abd_del complete
Jul 27 13:52:04 user nova-compute[70914]: INFO nova.compute.manager [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Took 1.11 seconds to destroy the instance on the hypervisor.
Jul 27 13:52:04 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465909.89786, 8377b22e-d359-47c3-bd2d-8b008b35a042 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:52:04 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] VM Stopped (Lifecycle Event)
Jul 27 13:52:04 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fdd30f81-02d9-4a7f-a164-f0b40bfdf4f6 None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:52:05 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:52:05 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Took 1.16 seconds to deallocate network for instance.
Jul 27 13:52:05 user nova-compute[70914]: WARNING nova.volume.cinder [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Attachment 37840e5c-8d76-4612-975b-0f0e4f0b0438 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 37840e5c-8d76-4612-975b-0f0e4f0b0438. (HTTP 404) (Request-ID: req-74d8ea66-eaa7-4d47-9f1c-22787b6cb614)
Jul 27 13:52:05 user nova-compute[70914]: INFO nova.compute.manager [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Took 0.03 seconds to detach 1 volumes for instance.
Jul 27 13:52:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-c023ff75-4179-43d1-9455-08f68a1af074 req-82e51bdf-6646-47aa-ad02-c769dc67351c service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received event network-vif-deleted-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-53bba08c-28de-4de7-bc12-779260aec39c req-1fbd89b3-435c-4116-872c-ea47629990ad service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received event network-vif-plugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-53bba08c-28de-4de7-bc12-779260aec39c req-1fbd89b3-435c-4116-872c-ea47629990ad service nova] Acquiring lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-53bba08c-28de-4de7-bc12-779260aec39c req-1fbd89b3-435c-4116-872c-ea47629990ad service nova] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-53bba08c-28de-4de7-bc12-779260aec39c req-1fbd89b3-435c-4116-872c-ea47629990ad service nova] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-53bba08c-28de-4de7-bc12-779260aec39c req-1fbd89b3-435c-4116-872c-ea47629990ad service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] No waiting events found dispatching network-vif-plugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:52:06 user nova-compute[70914]: WARNING nova.compute.manager [req-53bba08c-28de-4de7-bc12-779260aec39c req-1fbd89b3-435c-4116-872c-ea47629990ad service nova] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Received unexpected event network-vif-plugged-b3038fab-e57c-42fa-94da-f8aaf1a3fd3d for instance with vm_state deleted and task_state None.
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-45c30d0a-114d-4e56-b0c9-94ef58c6a478 req-2af3492a-ac25-4f92-8cde-2ae27cf2107f service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-45c30d0a-114d-4e56-b0c9-94ef58c6a478 req-2af3492a-ac25-4f92-8cde-2ae27cf2107f service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-45c30d0a-114d-4e56-b0c9-94ef58c6a478 req-2af3492a-ac25-4f92-8cde-2ae27cf2107f service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-45c30d0a-114d-4e56-b0c9-94ef58c6a478 req-2af3492a-ac25-4f92-8cde-2ae27cf2107f service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.manager [req-45c30d0a-114d-4e56-b0c9-94ef58c6a478 req-2af3492a-ac25-4f92-8cde-2ae27cf2107f service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:52:06 user nova-compute[70914]: WARNING nova.compute.manager [req-45c30d0a-114d-4e56-b0c9-94ef58c6a478 req-2af3492a-ac25-4f92-8cde-2ae27cf2107f service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state building and task_state spawning.
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:06 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Deleted allocations for instance e203cf51-97bf-4fc7-aa94-3a604c862abd
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465926.39536, fc2a646b-4612-44e3-b2c2-6c53fc65eef1 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:52:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] VM Resumed (Lifecycle Event)
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:52:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Instance spawned successfully.
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:52:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690465926.3962898, fc2a646b-4612-44e3-b2c2-6c53fc65eef1 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:52:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] VM Started (Lifecycle Event)
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:52:06 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f8e1aeb5-b955-4c47-888f-00c4f8747e4c tempest-VolumesSnapshotTestJSON-277407372 tempest-VolumesSnapshotTestJSON-277407372-project-member] Lock "e203cf51-97bf-4fc7-aa94-3a604c862abd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:06 user nova-compute[70914]: INFO nova.compute.manager [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Took 5.67 seconds to spawn the instance on the hypervisor.
Jul 27 13:52:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:52:06 user nova-compute[70914]: INFO nova.compute.manager [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Took 20.15 seconds to build instance.
Jul 27 13:52:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5a07a192-7bea-4be5-9255-14afa95b1eef tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.309s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:19 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465924.5206492, e203cf51-97bf-4fc7-aa94-3a604c862abd => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:52:19 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] VM Stopped (Lifecycle Event)
Jul 27 13:52:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b02a7d11-13e7-4bba-b793-3f1354bf0702 None None] [instance: e203cf51-97bf-4fc7-aa94-3a604c862abd] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:52:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:35 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:52:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 13:52:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] There are 0 instances to clean {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:36 user nova-compute[70914]: INFO nova.compute.manager [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Terminating instance
Jul 27 13:52:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-c4ba1417-eeb1-40ae-a866-50bbce3aafa2 req-c7c50d63-6caa-4142-9686-fb54fcd7c45b service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-vif-unplugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c4ba1417-eeb1-40ae-a866-50bbce3aafa2 req-c7c50d63-6caa-4142-9686-fb54fcd7c45b service nova] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c4ba1417-eeb1-40ae-a866-50bbce3aafa2 req-c7c50d63-6caa-4142-9686-fb54fcd7c45b service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c4ba1417-eeb1-40ae-a866-50bbce3aafa2 req-c7c50d63-6caa-4142-9686-fb54fcd7c45b service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-c4ba1417-eeb1-40ae-a866-50bbce3aafa2 req-c7c50d63-6caa-4142-9686-fb54fcd7c45b service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] No waiting events found dispatching network-vif-unplugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-c4ba1417-eeb1-40ae-a866-50bbce3aafa2 req-c7c50d63-6caa-4142-9686-fb54fcd7c45b service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-vif-unplugged-7987dffb-bb71-444e-b737-5c05b30e972b for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:37 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Instance destroyed successfully.
Jul 27 13:52:37 user nova-compute[70914]: DEBUG nova.objects.instance [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'resources' on Instance uuid 3b8cffe7-b0ad-487b-8229-54469afefdd2 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1759781246',display_name='tempest-ServerActionsTestOtherA-server-1759781246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1759781246',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:48:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-o61s0k8m',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=3b8cffe7-b0ad-487b-8229-54469afefdd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "7987dffb-bb71-444e-b737-5c05b30e972b", "address": "fa:16:3e:f2:ce:a9", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7987dffb-bb", "ovs_interfaceid": "7987dffb-bb71-444e-b737-5c05b30e972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_vif [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7987dffb-bb, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:37 user nova-compute[70914]: INFO os_vif [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ce:a9,bridge_name='br-int',has_traffic_filtering=True,id=7987dffb-bb71-444e-b737-5c05b30e972b,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7987dffb-bb')
Jul 27 13:52:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvDGkwep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:52:37 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a819cd-be5c-4661-aef4-eeb1faad4af2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:52:37 user nova-compute[70914]: No targets found.
Jul 27 13:52:37 user nova-compute[70914]: iSNS:
Jul 27 13:52:37 user nova-compute[70914]: No targets found.
Jul 27 13:52:37 user nova-compute[70914]: STATIC:
Jul 27 13:52:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:52:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3
Jul 27 13:52:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac
Jul 27 13:52:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:37 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e
Jul 27 13:52:37 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:37 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:37 user nova-compute[70914]: FIRMWARE:
Jul 27 13:52:37 user nova-compute[70914]: No targets found.
Jul 27 13:52:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:52:37 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:52:37 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[474e5634-8181-464d-affa-ad817219c448]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7b608b-ff9e-4edf-bbaf-d520f7eb2749]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:37 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:52:37 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:37 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:52:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:37 user nova-compute[70914]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 (non-flash)
Jul 27 13:52:37 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:37 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:52:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18400dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3'): ({'sdd'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Removing single pathed devices sdd {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c1e9f3-6550-4a10-8185-014688e23a8b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[616ec490-7a8a-4177-9882-5f604058f452]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Flushing IO for device /dev/sdd {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7ba60b-4841-4a65-8d00-1ca8666daf87]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9f1500-31ba-4922-bc08-317a3b7b67f4]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b643e92-d332-4f86-87ea-cf3ffa9eaade]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3f5af8-dc44-4a98-839c-283685567c80]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260]
Jul 27 13:52:37 user nova-compute[70914]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3, portal: 172.16.0.220,3260] successful.
Jul 27 13:52:37 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafdbf40-2399-4ec2-8c9d-4504787a18f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[33566e7f-e640-4693-a53b-d7b08a64410a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] <== disconnect_volume: return (367ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:52:37 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Deleting instance files /opt/stack/data/nova/instances/3b8cffe7-b0ad-487b-8229-54469afefdd2_del
Jul 27 13:52:37 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Deletion of /opt/stack/data/nova/instances/3b8cffe7-b0ad-487b-8229-54469afefdd2_del complete
Jul 27 13:52:37 user nova-compute[70914]: INFO nova.compute.manager [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Took 1.27 seconds to destroy the instance on the hypervisor.
Jul 27 13:52:37 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:52:37 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:52:38 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:52:38 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Took 0.96 seconds to deallocate network for instance.
Jul 27 13:52:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-27710b36-dabf-4d36-b013-f8ff31b803aa req-838c3291-a201-4c7c-9599-1fcd17c2834a service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:52:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-27710b36-dabf-4d36-b013-f8ff31b803aa req-838c3291-a201-4c7c-9599-1fcd17c2834a service nova] Acquiring lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-27710b36-dabf-4d36-b013-f8ff31b803aa req-838c3291-a201-4c7c-9599-1fcd17c2834a service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-27710b36-dabf-4d36-b013-f8ff31b803aa req-838c3291-a201-4c7c-9599-1fcd17c2834a service nova] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-27710b36-dabf-4d36-b013-f8ff31b803aa req-838c3291-a201-4c7c-9599-1fcd17c2834a service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] No waiting events found dispatching network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:52:39 user nova-compute[70914]: WARNING nova.compute.manager [req-27710b36-dabf-4d36-b013-f8ff31b803aa req-838c3291-a201-4c7c-9599-1fcd17c2834a service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received unexpected event network-vif-plugged-7987dffb-bb71-444e-b737-5c05b30e972b for instance with vm_state active and task_state deleting.
Jul 27 13:52:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-27710b36-dabf-4d36-b013-f8ff31b803aa req-838c3291-a201-4c7c-9599-1fcd17c2834a service nova] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Received event network-vif-deleted-7987dffb-bb71-444e-b737-5c05b30e972b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:52:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:39 user nova-compute[70914]: INFO nova.compute.manager [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Took 0.77 seconds to detach 1 volumes for instance.
Jul 27 13:52:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Deleting volume: aafdbf40-2399-4ec2-8c9d-4504787a18f3 {{(pid=70914) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 13:52:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:39 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:52:39 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:52:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:40 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Deleted allocations for instance 3b8cffe7-b0ad-487b-8229-54469afefdd2
Jul 27 13:52:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e54d7fb-2c1c-4b71-88ba-a3d9b482dfac tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "3b8cffe7-b0ad-487b-8229-54469afefdd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.570s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-changed-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Refreshing instance network info cache due to event network-changed-579d72f4-5dd4-4666-9beb-2ca8049b1475. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] Acquiring lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] Acquired lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Refreshing network info cache for port 579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:41 user nova-compute[70914]: INFO nova.compute.manager [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Detaching volume e858d583-9cb1-476e-aff1-d8fca78eb49e
Jul 27 13:52:41 user nova-compute[70914]: INFO nova.virt.block_device [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Attempting to driver detach volume e858d583-9cb1-476e-aff1-d8fca78eb49e from mountpoint /dev/vdb
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Attempting to detach device vdb from instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:52:41 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:52:41 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:52:41 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:52:41 user nova-compute[70914]:   <serial>e858d583-9cb1-476e-aff1-d8fca78eb49e</serial>
Jul 27 13:52:41 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:52:41 user nova-compute[70914]: </disk>
Jul 27 13:52:41 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:52:41 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Successfully detached device vdb from instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 from the persistent domain config.
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:52:41 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:52:41 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:52:41 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:52:41 user nova-compute[70914]:   <serial>e858d583-9cb1-476e-aff1-d8fca78eb49e</serial>
Jul 27 13:52:41 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:52:41 user nova-compute[70914]: </disk>
Jul 27 13:52:41 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updated VIF entry in instance network info cache for port 579d72f4-5dd4-4666-9beb-2ca8049b1475. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updating instance_info_cache with network_info: [{"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] Releasing lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-changed-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Refreshing instance network info cache due to event network-changed-579d72f4-5dd4-4666-9beb-2ca8049b1475. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] Acquiring lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] Acquired lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Refreshing network info cache for port 579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690465961.647235, 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:52:41 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Successfully detached device vdb from instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 from the live domain config.
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJBxjRGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:52:41 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e83373-9623-4e3c-a46d-7f6f6997e97b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:52:41 user nova-compute[70914]: No targets found.
Jul 27 13:52:41 user nova-compute[70914]: iSNS:
Jul 27 13:52:41 user nova-compute[70914]: No targets found.
Jul 27 13:52:41 user nova-compute[70914]: STATIC:
Jul 27 13:52:41 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:52:41 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:41 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:41 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac
Jul 27 13:52:41 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:41 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:41 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e
Jul 27 13:52:41 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:52:41 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:52:41 user nova-compute[70914]: FIRMWARE:
Jul 27 13:52:41 user nova-compute[70914]: No targets found.
Jul 27 13:52:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:52:41 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:52:41 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5858d10-01a2-43c5-b2a4-a6826e4c5422]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3674bc86-1534-4bac-8a40-865834e41d9d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:41 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:41 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:52:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:52:41 user nova-compute[70914]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e (non-flash)
Jul 27 13:52:41 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:52:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c381e92d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7071f3bc-4258-4dc3-8831-8ccd0b58b835]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[792b2b87-c8e8-4de2-9ec4-496c604b4c20]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fea714-09bd-4c09-8c3d-2d34ad153b66]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cc1bd8-2ec8-4837-aee3-73e3ab3e70b1]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cf904e-b20e-4157-bd43-69e81b94cd8e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d5103e-0f5a-4897-adcd-cda0daaf175a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e, portal: 172.16.0.220,3260]
Jul 27 13:52:41 user nova-compute[70914]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e, portal: 172.16.0.220,3260] successful.
Jul 27 13:52:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858d583-9cb1-476e-aff1-d8fca78eb49e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd408af-a09d-4050-a54c-333ca576e503]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] <== disconnect_volume: return (327ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:52:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:52:42 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updated VIF entry in instance network info cache for port 579d72f4-5dd4-4666-9beb-2ca8049b1475. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:52:42 user nova-compute[70914]: DEBUG nova.network.neutron [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updating instance_info_cache with network_info: [{"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:52:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-b4b2193c-5a69-4c06-aa1d-e6f99db7693f req-b09a0fe1-341d-4c52-89f2-cece8e55512c service nova] Releasing lock "refresh_cache-2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:52:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:42 user nova-compute[70914]: DEBUG nova.objects.instance [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'flavor' on Instance uuid 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:52:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9cf53a49-29c7-4b06-9de6-001e0d429870 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.606s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690465957.3391557, 3b8cffe7-b0ad-487b-8229-54469afefdd2 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:52:52 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] VM Stopped (Lifecycle Event)
Jul 27 13:52:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c554cf2d-5809-4d23-82c4-147d3944f3f1 None None] [instance: 3b8cffe7-b0ad-487b-8229-54469afefdd2] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:52:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:52:53 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:52:53 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8116MB free_disk=25.188461303710938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 814e062c-85d1-486b-8c7e-9198fbfc5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cd4b9913-ab18-42d7-abd7-c4dad48375c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance fc2a646b-4612-44e3-b2c2-6c53fc65eef1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances with incomplete migration  {{(pid=70914) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 13:52:53 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:52:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:52:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:52:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:52:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:52:57 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:52:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:52:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:52:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:52:57 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:52:58 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Updating instance_info_cache with network_info: [{"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:52:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:52:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:52:58 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:00 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:53:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:53:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:33 user nova-compute[70914]: INFO nova.compute.manager [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Terminating instance
Jul 27 13:53:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-24c5ec5d-bbe1-42cd-b278-8f768c1a1b5e req-4422a949-5e04-4542-a1d5-a39390623eaa service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-vif-unplugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-24c5ec5d-bbe1-42cd-b278-8f768c1a1b5e req-4422a949-5e04-4542-a1d5-a39390623eaa service nova] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-24c5ec5d-bbe1-42cd-b278-8f768c1a1b5e req-4422a949-5e04-4542-a1d5-a39390623eaa service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-24c5ec5d-bbe1-42cd-b278-8f768c1a1b5e req-4422a949-5e04-4542-a1d5-a39390623eaa service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-24c5ec5d-bbe1-42cd-b278-8f768c1a1b5e req-4422a949-5e04-4542-a1d5-a39390623eaa service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] No waiting events found dispatching network-vif-unplugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-24c5ec5d-bbe1-42cd-b278-8f768c1a1b5e req-4422a949-5e04-4542-a1d5-a39390623eaa service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-vif-unplugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:53:33 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Instance destroyed successfully.
Jul 27 13:53:33 user nova-compute[70914]: DEBUG nova.objects.instance [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lazy-loading 'resources' on Instance uuid 814e062c-85d1-486b-8c7e-9198fbfc5f63 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-930458355',display_name='tempest-ServerActionsTestOtherA-server-85355233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-930458355',id=17,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwjZ0I9RKQNVwEUOErbjI/ofI3YhTRywMo2zS2+utP4T9LXG/3nBU6CU8QpWhlGVtO068Rv/cSPRCaGwGzmlzHaWCWjoDMwo4QXS8kJ/C6GYtEL8uZelYl91q5SWjwm+Q==',key_name='tempest-keypair-1078508443',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:41:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5da684ade5ad4a328eb543f6d6da0ad9',ramdisk_id='',reservation_id='r-82o8h0rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1561010505',owner_user_name='tempest-ServerActionsTestOtherA-1561010505-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='252ad07dbf034a09b3be3c05dba67b3f',uuid=814e062c-85d1-486b-8c7e-9198fbfc5f63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converting VIF {"id": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "address": "fa:16:3e:f6:64:4a", "network": {"id": "dc1c669c-a365-4c11-ae50-2d26a3d0bef8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-947919029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5da684ade5ad4a328eb543f6d6da0ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f7f5f5-e9", "ovs_interfaceid": "31f7f5f5-e982-4083-a3dd-48fd7e526cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG os_vif [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31f7f5f5-e9, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:53:33 user nova-compute[70914]: INFO os_vif [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=31f7f5f5-e982-4083-a3dd-48fd7e526cd5,network=Network(dc1c669c-a365-4c11-ae50-2d26a3d0bef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f7f5f5-e9')
Jul 27 13:53:33 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Deleting instance files /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63_del
Jul 27 13:53:33 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Deletion of /opt/stack/data/nova/instances/814e062c-85d1-486b-8c7e-9198fbfc5f63_del complete
Jul 27 13:53:33 user nova-compute[70914]: INFO nova.compute.manager [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 27 13:53:33 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:53:33 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:53:34 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:53:34 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Took 0.53 seconds to deallocate network for instance.
Jul 27 13:53:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:34 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Refreshing inventories for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 13:53:34 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Updating ProviderTree inventory for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 13:53:34 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 13:53:34 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Refreshing aggregate associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, aggregates: None {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 13:53:34 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Refreshing trait associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 13:53:35 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:53:35 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:53:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:35 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Deleted allocations for instance 814e062c-85d1-486b-8c7e-9198fbfc5f63
Jul 27 13:53:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fa15e3d9-019e-4060-8bfe-a42e4ddfe2ff tempest-ServerActionsTestOtherA-1561010505 tempest-ServerActionsTestOtherA-1561010505-project-member] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.280s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-1758620d-422e-42dc-a0af-3df1477265d5 req-3c9c502b-2372-425b-b025-98a3bbc11c5c service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1758620d-422e-42dc-a0af-3df1477265d5 req-3c9c502b-2372-425b-b025-98a3bbc11c5c service nova] Acquiring lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1758620d-422e-42dc-a0af-3df1477265d5 req-3c9c502b-2372-425b-b025-98a3bbc11c5c service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1758620d-422e-42dc-a0af-3df1477265d5 req-3c9c502b-2372-425b-b025-98a3bbc11c5c service nova] Lock "814e062c-85d1-486b-8c7e-9198fbfc5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-1758620d-422e-42dc-a0af-3df1477265d5 req-3c9c502b-2372-425b-b025-98a3bbc11c5c service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] No waiting events found dispatching network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:53:35 user nova-compute[70914]: WARNING nova.compute.manager [req-1758620d-422e-42dc-a0af-3df1477265d5 req-3c9c502b-2372-425b-b025-98a3bbc11c5c service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received unexpected event network-vif-plugged-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 for instance with vm_state deleted and task_state None.
Jul 27 13:53:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-1758620d-422e-42dc-a0af-3df1477265d5 req-3c9c502b-2372-425b-b025-98a3bbc11c5c service nova] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Received event network-vif-deleted-31f7f5f5-e982-4083-a3dd-48fd7e526cd5 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:37 user nova-compute[70914]: INFO nova.compute.manager [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Rescuing
Jul 27 13:53:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:53:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquired lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:53:37 user nova-compute[70914]: DEBUG nova.network.neutron [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:38 user nova-compute[70914]: INFO nova.compute.manager [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Terminating instance
Jul 27 13:53:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG nova.network.neutron [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Updating instance_info_cache with network_info: [{"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Releasing lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-150a9ee5-3cc7-49a6-a5e6-125d97db05eb req-12862e0e-7d7f-4232-bfca-27fb451b5721 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-vif-unplugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-150a9ee5-3cc7-49a6-a5e6-125d97db05eb req-12862e0e-7d7f-4232-bfca-27fb451b5721 service nova] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-150a9ee5-3cc7-49a6-a5e6-125d97db05eb req-12862e0e-7d7f-4232-bfca-27fb451b5721 service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-150a9ee5-3cc7-49a6-a5e6-125d97db05eb req-12862e0e-7d7f-4232-bfca-27fb451b5721 service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-150a9ee5-3cc7-49a6-a5e6-125d97db05eb req-12862e0e-7d7f-4232-bfca-27fb451b5721 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] No waiting events found dispatching network-vif-unplugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-150a9ee5-3cc7-49a6-a5e6-125d97db05eb req-12862e0e-7d7f-4232-bfca-27fb451b5721 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-vif-unplugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:38 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Instance destroyed successfully.
Jul 27 13:53:38 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lazy-loading 'resources' on Instance uuid 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-367379119',display_name='tempest-TestMinimumBasicScenario-server-367379119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-367379119',id=32,image_ref='736025cd-261b-456a-91ce-741a180d9332',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaJ1e4bDzGsvRJxN4V/y03/DRGlu2b/BHXmvIrdsQBD3hfNEaGbW+P/W3feD5HfIZS2kA3wU7XxTeJn9zwRzJCZTqHTXBU8cYGwSC9RiGGg0eyIHXNrsrpnFTx97uHyMA==',key_name='tempest-TestMinimumBasicScenario-695460095',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:48:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45941da6cb4b3a8c7394cc649e62e5',ramdisk_id='',reservation_id='r-3e6qk4p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='736025cd-261b-456a-91ce-741a180d9332',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-779682044',owner_user_name='tempest-TestMinimumBasicScenario-779682044-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:50:54Z,user_data=None,user_id='340b2ab1e12b4e0491b86f3eb2596cd1',uuid=2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converting VIF {"id": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "address": "fa:16:3e:ca:16:bb", "network": {"id": "12face84-2e4e-47a6-80e8-8d8269cd4a24", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1494997502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45941da6cb4b3a8c7394cc649e62e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579d72f4-5d", "ovs_interfaceid": "579d72f4-5dd4-4666-9beb-2ca8049b1475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:16:bb,bridge_name='br-int',has_traffic_filtering=True,id=579d72f4-5dd4-4666-9beb-2ca8049b1475,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579d72f4-5d') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG os_vif [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:16:bb,bridge_name='br-int',has_traffic_filtering=True,id=579d72f4-5dd4-4666-9beb-2ca8049b1475,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579d72f4-5d') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap579d72f4-5d, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:39 user nova-compute[70914]: INFO os_vif [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:16:bb,bridge_name='br-int',has_traffic_filtering=True,id=579d72f4-5dd4-4666-9beb-2ca8049b1475,network=Network(12face84-2e4e-47a6-80e8-8d8269cd4a24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579d72f4-5d')
Jul 27 13:53:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Deleting instance files /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12_del
Jul 27 13:53:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Deletion of /opt/stack/data/nova/instances/2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12_del complete
Jul 27 13:53:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:39 user nova-compute[70914]: INFO nova.compute.manager [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 27 13:53:39 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-9b5d325c-6300-4a1e-b826-857f20c39a10 req-c941bf72-1c60-4266-972c-91e1726b29d6 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-unplugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9b5d325c-6300-4a1e-b826-857f20c39a10 req-c941bf72-1c60-4266-972c-91e1726b29d6 service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9b5d325c-6300-4a1e-b826-857f20c39a10 req-c941bf72-1c60-4266-972c-91e1726b29d6 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9b5d325c-6300-4a1e-b826-857f20c39a10 req-c941bf72-1c60-4266-972c-91e1726b29d6 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-9b5d325c-6300-4a1e-b826-857f20c39a10 req-c941bf72-1c60-4266-972c-91e1726b29d6 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-unplugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:53:39 user nova-compute[70914]: WARNING nova.compute.manager [req-9b5d325c-6300-4a1e-b826-857f20c39a10 req-c941bf72-1c60-4266-972c-91e1726b29d6 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-unplugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state active and task_state rescuing.
Jul 27 13:53:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Instance destroyed successfully.
Jul 27 13:53:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Attempting a stable device rescue
Jul 27 13:53:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70914) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Instance directory exists: not creating {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 13:53:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Creating image(s)
Jul 27 13:53:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "/opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "/opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc2a646b-4612-44e3-b2c2-6c53fc65eef1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "a46d6032a95feefb67d1e9f970e6aee86a8a08aa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "a46d6032a95feefb67d1e9f970e6aee86a8a08aa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:39 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa.part --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:40 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Took 1.52 seconds to deallocate network for instance.
Jul 27 13:53:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa.part --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG nova.virt.images [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] 1c3973ee-a843-4ff2-9565-d5577f4a7386 was qcow2, converting to raw {{(pid=70914) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa.part /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa.converted {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-7c0a359e-cc24-4600-8b3b-34bdd918d503 req-cf6e9e78-51a8-475e-9475-d0f3754c88d7 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7c0a359e-cc24-4600-8b3b-34bdd918d503 req-cf6e9e78-51a8-475e-9475-d0f3754c88d7 service nova] Acquiring lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7c0a359e-cc24-4600-8b3b-34bdd918d503 req-cf6e9e78-51a8-475e-9475-d0f3754c88d7 service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7c0a359e-cc24-4600-8b3b-34bdd918d503 req-cf6e9e78-51a8-475e-9475-d0f3754c88d7 service nova] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-7c0a359e-cc24-4600-8b3b-34bdd918d503 req-cf6e9e78-51a8-475e-9475-d0f3754c88d7 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] No waiting events found dispatching network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:53:40 user nova-compute[70914]: WARNING nova.compute.manager [req-7c0a359e-cc24-4600-8b3b-34bdd918d503 req-cf6e9e78-51a8-475e-9475-d0f3754c88d7 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received unexpected event network-vif-plugged-579d72f4-5dd4-4666-9beb-2ca8049b1475 for instance with vm_state deleted and task_state None.
Jul 27 13:53:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-7c0a359e-cc24-4600-8b3b-34bdd918d503 req-cf6e9e78-51a8-475e-9475-d0f3754c88d7 service nova] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Received event network-vif-deleted-579d72f4-5dd4-4666-9beb-2ca8049b1475 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-2503dd43-95cf-4327-827c-31cd685a32a1 req-2ef5a119-e5c4-4667-916d-033adf40e9a7 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2503dd43-95cf-4327-827c-31cd685a32a1 req-2ef5a119-e5c4-4667-916d-033adf40e9a7 service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2503dd43-95cf-4327-827c-31cd685a32a1 req-2ef5a119-e5c4-4667-916d-033adf40e9a7 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2503dd43-95cf-4327-827c-31cd685a32a1 req-2ef5a119-e5c4-4667-916d-033adf40e9a7 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-2503dd43-95cf-4327-827c-31cd685a32a1 req-2ef5a119-e5c4-4667-916d-033adf40e9a7 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:53:41 user nova-compute[70914]: WARNING nova.compute.manager [req-2503dd43-95cf-4327-827c-31cd685a32a1 req-2ef5a119-e5c4-4667-916d-033adf40e9a7 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state active and task_state rescuing.
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa.part /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa.converted" returned: 0 in 0.510s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa.converted --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:41 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Deleted allocations for instance 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0ef534b-81f3-4f70-837d-c85c6ab78378 tempest-TestMinimumBasicScenario-779682044 tempest-TestMinimumBasicScenario-779682044-project-member] Lock "2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.257s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "a46d6032a95feefb67d1e9f970e6aee86a8a08aa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.857s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "a46d6032a95feefb67d1e9f970e6aee86a8a08aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "a46d6032a95feefb67d1e9f970e6aee86a8a08aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa,backing_fmt=raw /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa,backing_fmt=raw /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue" returned: 0 in 0.050s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "a46d6032a95feefb67d1e9f970e6aee86a8a08aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'migration_context' on Instance uuid fc2a646b-4612-44e3-b2c2-6c53fc65eef1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Start _get_guest_xml network_info=[{"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "vif_mac": "fa:16:3e:2f:4f:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1c3973ee-a843-4ff2-9565-d5577f4a7386', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'f4fbc5b8-5d07-4975-bb56-575d7611ec58', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYnvQLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'fc2a646b-4612-44e3-b2c2-6c53fc65eef1', 'attached_at': '', 'detached_at': '', 'volume_id': '593c0e00-4003-4fe6-abca-df81c661f0ac', 'serial': '593c0e00-4003-4fe6-abca-df81c661f0ac'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'resources' on Instance uuid fc2a646b-4612-44e3-b2c2-6c53fc65eef1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'numa_topology' on Instance uuid fc2a646b-4612-44e3-b2c2-6c53fc65eef1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:41 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:53:41 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc2a646b-4612-44e3-b2c2-6c53fc65eef1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYnvQLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:53:41 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:53:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:53:41 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:53:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:53:41 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260" returned: 0 in 0.049s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[821987a3-2b86-454b-a22a-f99a04071687]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZYnvQLJm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 13:53:41 user nova-compute[70914]: node.name = iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac
Jul 27 13:53:41 user nova-compute[70914]: node.tpgt = -1
Jul 27 13:53:41 user nova-compute[70914]: node.startup = automatic
Jul 27 13:53:41 user nova-compute[70914]: node.leading_login = No
Jul 27 13:53:41 user nova-compute[70914]: iface.iscsi_ifacename = default
Jul 27 13:53:41 user nova-compute[70914]: iface.net_ifacename = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.ipaddress = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.prefix_len = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.hwaddress = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.transport_name = tcp
Jul 27 13:53:41 user nova-compute[70914]: iface.initiatorname = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.state = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.vlan_id = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.vlan_priority = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.vlan_state = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.iface_num = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.mtu = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.port = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.bootproto = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.subnet_mask = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.gateway = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.dhcp_alt_client_id = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.dhcp_dns = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.dhcp_learn_iqn = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.dhcp_vendor_id_state = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.dhcp_vendor_id = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.dhcp_slp_da = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.fragmentation = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.gratuitous_arp = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.incoming_forwarding = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.tos_state = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.tos = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.ttl = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.delayed_ack = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.tcp_nagle = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.tcp_wsf_state = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.tcp_wsf = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.tcp_timer_scale = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.tcp_timestamp = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.redirect = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.def_task_mgmt_timeout = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.header_digest = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.data_digest = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.immediate_data = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.initial_r2t = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.data_seq_inorder = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.data_pdu_inorder = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.erl = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.max_receive_data_len = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.first_burst_len = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.max_outstanding_r2t = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.max_burst_len = 0
Jul 27 13:53:41 user nova-compute[70914]: iface.chap_auth = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.bidi_chap = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.strict_login_compliance = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.discovery_auth = <empty>
Jul 27 13:53:41 user nova-compute[70914]: iface.discovery_logout = <empty>
Jul 27 13:53:41 user nova-compute[70914]: node.discovery_address = <empty>
Jul 27 13:53:41 user nova-compute[70914]: node.discovery_port = 0
Jul 27 13:53:41 user nova-compute[70914]: node.discovery_type = static
Jul 27 13:53:41 user nova-compute[70914]: node.session.initial_cmdsn = 0
Jul 27 13:53:41 user nova-compute[70914]: node.session.initial_login_retry_max = 8
Jul 27 13:53:41 user nova-compute[70914]: node.session.xmit_thread_priority = -20
Jul 27 13:53:41 user nova-compute[70914]: node.session.cmds_max = 128
Jul 27 13:53:41 user nova-compute[70914]: node.session.queue_depth = 32
Jul 27 13:53:41 user nova-compute[70914]: node.session.nr_sessions = 1
Jul 27 13:53:41 user nova-compute[70914]: node.session.auth.authmethod = CHAP
Jul 27 13:53:41 user nova-compute[70914]: node.session.auth.username = ZYnvQLJm
Jul 27 13:53:41 user nova-compute[70914]: node.session.auth.password = ***
Jul 27 13:53:41 user nova-compute[70914]: node.session.auth.username_in = <empty>
Jul 27 13:53:41 user nova-compute[70914]: node.session.auth.password_in = <empty>
Jul 27 13:53:41 user nova-compute[70914]: node.session.auth.chap_algs = MD5
Jul 27 13:53:41 user nova-compute[70914]: node.session.timeo.replacement_timeout = 120
Jul 27 13:53:41 user nova-compute[70914]: node.session.err_timeo.abort_timeout = 15
Jul 27 13:53:41 user nova-compute[70914]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 13:53:41 user nova-compute[70914]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 13:53:41 user nova-compute[70914]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 13:53:41 user nova-compute[70914]: node.session.iscsi.FastAbort = Yes
Jul 27 13:53:41 user nova-compute[70914]: node.session.iscsi.InitialR2T = No
Jul 27 13:53:41 user nova-compute[70914]: node.session.iscsi.ImmediateData = Yes
Jul 27 13:53:41 user nova-compute[70914]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 13:53:41 user nova-compute[70914]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 13:53:41 user nova-compute[70914]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 13:53:41 user nova-compute[70914]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 13:53:41 user nova-compute[70914]: node.session.iscsi.MaxConnections = 1
Jul 27 13:53:41 user nova-compute[70914]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 13:53:41 user nova-compute[70914]: node.session.iscsi.ERL = 0
Jul 27 13:53:41 user nova-compute[70914]: node.session.scan = manual
Jul 27 13:53:41 user nova-compute[70914]: node.session.reopen_max = 0
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].address = 172.16.0.220
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].port = 3260
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].startup = manual
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].tcp.window_size = 524288
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].tcp.type_of_service = 0
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].timeo.logout_timeout = 15
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].timeo.login_timeout = 15
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].timeo.auth_timeout = 45
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].iscsi.DataDigest = None
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].iscsi.IFMarker = No
Jul 27 13:53:41 user nova-compute[70914]: node.conn[0].iscsi.OFMarker = No
Jul 27 13:53:41 user nova-compute[70914]: # END RECORD
Jul 27 13:53:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:53:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc188df-9e16-4207-b537-9fba07b3e980]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5191a758-a98e-40cf-9fa8-1d192640a53c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYnvQLJm {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYnvQLJm" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3a7f59-247e-4167-b1cb-f3cc345abbcb]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZYnvQLJm'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6466cb52-f6ba-427c-b75c-398ab15aff15]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[419ff59f-441f-42e3-a8ff-2fa22c225823]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:53:42 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:53:42 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:53:42 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:53:42 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] HCTL ('37', '0', '0', 0) found on session 44 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1b0809-f369-407a-83e6-e4eaaf99ab41]: (4, ('0 0 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Searching for a device in session 44 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYnvQLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.280s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] <== connect_volume: return (281ms) {'type': 'block', 'scsi_wwn': '26531643431386566', 'path': '/dev/sdf'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531643431386566', 'path': '/dev/sdf'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-521589190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-521589190',id=36,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-rpv2cmmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:52:07Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=fc2a646b-4612-44e3-b2c2-6c53fc65eef1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "vif_mac": "fa:16:3e:2f:4f:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "vif_mac": "fa:16:3e:2f:4f:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:4f:ed,bridge_name='br-int',has_traffic_filtering=True,id=98d96a87-1eef-4e20-beef-a4f9e31205f3,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d96a87-1e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2a646b-4612-44e3-b2c2-6c53fc65eef1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:53:42 user nova-compute[70914]:   <uuid>fc2a646b-4612-44e3-b2c2-6c53fc65eef1</uuid>
Jul 27 13:53:42 user nova-compute[70914]:   <name>instance-00000024</name>
Jul 27 13:53:42 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:53:42 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:53:42 user nova-compute[70914]:   <metadata>
Jul 27 13:53:42 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:53:42 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:53:42 user nova-compute[70914]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-521589190</nova:name>
Jul 27 13:53:42 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:53:41</nova:creationTime>
Jul 27 13:53:42 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:53:42 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:53:42 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:53:42 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:53:42 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:53:42 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:53:42 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:53:42 user nova-compute[70914]:       <nova:owner>
Jul 27 13:53:42 user nova-compute[70914]:         <nova:user uuid="89bc44e787074838ba46afd3f81262f0">tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member</nova:user>
Jul 27 13:53:42 user nova-compute[70914]:         <nova:project uuid="e9647080d1194d60aeb390b127895474">tempest-ServerBootFromVolumeStableRescueTest-853279030</nova:project>
Jul 27 13:53:42 user nova-compute[70914]:       </nova:owner>
Jul 27 13:53:42 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:53:42 user nova-compute[70914]:       <nova:ports>
Jul 27 13:53:42 user nova-compute[70914]:         <nova:port uuid="98d96a87-1eef-4e20-beef-a4f9e31205f3">
Jul 27 13:53:42 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 13:53:42 user nova-compute[70914]:         </nova:port>
Jul 27 13:53:42 user nova-compute[70914]:       </nova:ports>
Jul 27 13:53:42 user nova-compute[70914]:     </nova:instance>
Jul 27 13:53:42 user nova-compute[70914]:   </metadata>
Jul 27 13:53:42 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:53:42 user nova-compute[70914]:     <system>
Jul 27 13:53:42 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:53:42 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:53:42 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:53:42 user nova-compute[70914]:       <entry name="serial">fc2a646b-4612-44e3-b2c2-6c53fc65eef1</entry>
Jul 27 13:53:42 user nova-compute[70914]:       <entry name="uuid">fc2a646b-4612-44e3-b2c2-6c53fc65eef1</entry>
Jul 27 13:53:42 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:53:42 user nova-compute[70914]:     </system>
Jul 27 13:53:42 user nova-compute[70914]:   </sysinfo>
Jul 27 13:53:42 user nova-compute[70914]:   <os>
Jul 27 13:53:42 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:53:42 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:53:42 user nova-compute[70914]:   </os>
Jul 27 13:53:42 user nova-compute[70914]:   <features>
Jul 27 13:53:42 user nova-compute[70914]:     <acpi/>
Jul 27 13:53:42 user nova-compute[70914]:     <apic/>
Jul 27 13:53:42 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:53:42 user nova-compute[70914]:   </features>
Jul 27 13:53:42 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:53:42 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:53:42 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:53:42 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:53:42 user nova-compute[70914]:   </clock>
Jul 27 13:53:42 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:53:42 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:53:42 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:53:42 user nova-compute[70914]:   </cpu>
Jul 27 13:53:42 user nova-compute[70914]:   <devices>
Jul 27 13:53:42 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:53:42 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:53:42 user nova-compute[70914]:       <source dev="/dev/sdf"/>
Jul 27 13:53:42 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:53:42 user nova-compute[70914]:       <serial>593c0e00-4003-4fe6-abca-df81c661f0ac</serial>
Jul 27 13:53:42 user nova-compute[70914]:     </disk>
Jul 27 13:53:42 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:53:42 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:53:42 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue"/>
Jul 27 13:53:42 user nova-compute[70914]:       <target dev="vdb" bus="virtio"/>
Jul 27 13:53:42 user nova-compute[70914]:       <boot order="1"/>
Jul 27 13:53:42 user nova-compute[70914]:     </disk>
Jul 27 13:53:42 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:53:42 user nova-compute[70914]:       <mac address="fa:16:3e:2f:4f:ed"/>
Jul 27 13:53:42 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:53:42 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:53:42 user nova-compute[70914]:       <target dev="tap98d96a87-1e"/>
Jul 27 13:53:42 user nova-compute[70914]:     </interface>
Jul 27 13:53:42 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:53:42 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/console.log" append="off"/>
Jul 27 13:53:42 user nova-compute[70914]:     </serial>
Jul 27 13:53:42 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:53:42 user nova-compute[70914]:     <video>
Jul 27 13:53:42 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:53:42 user nova-compute[70914]:     </video>
Jul 27 13:53:42 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:53:42 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:53:42 user nova-compute[70914]:     </rng>
Jul 27 13:53:42 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:53:42 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:53:42 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:53:42 user nova-compute[70914]:     </memballoon>
Jul 27 13:53:42 user nova-compute[70914]:   </devices>
Jul 27 13:53:42 user nova-compute[70914]: </domain>
Jul 27 13:53:42 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:53:42 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Instance destroyed successfully.
Jul 27 13:53:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:53:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] No VIF found with MAC fa:16:3e:2f:4f:ed, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:43 user nova-compute[70914]: INFO nova.compute.manager [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Unshelving
Jul 27 13:53:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG nova.objects.instance [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'pci_requests' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG nova.objects.instance [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'numa_topology' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:53:43 user nova-compute[70914]: INFO nova.compute.claims [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Claim successful on node user
Jul 27 13:53:43 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:43 user nova-compute[70914]: INFO nova.network.neutron [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updating port 6ce0387e-c296-41be-b5e6-9d5ab538cec8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG nova.compute.manager [req-582bda31-30b7-4528-aac8-00cb5ecf3fff req-6f05a551-ba0d-4282-9e58-6cf32939c784 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-582bda31-30b7-4528-aac8-00cb5ecf3fff req-6f05a551-ba0d-4282-9e58-6cf32939c784 service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-582bda31-30b7-4528-aac8-00cb5ecf3fff req-6f05a551-ba0d-4282-9e58-6cf32939c784 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-582bda31-30b7-4528-aac8-00cb5ecf3fff req-6f05a551-ba0d-4282-9e58-6cf32939c784 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG nova.compute.manager [req-582bda31-30b7-4528-aac8-00cb5ecf3fff req-6f05a551-ba0d-4282-9e58-6cf32939c784 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:53:43 user nova-compute[70914]: WARNING nova.compute.manager [req-582bda31-30b7-4528-aac8-00cb5ecf3fff req-6f05a551-ba0d-4282-9e58-6cf32939c784 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state active and task_state rescuing.
Jul 27 13:53:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:53:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquired lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:53:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:53:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-854973cd-e2f4-42ce-ae3a-ed312e7ce718 req-c48ae175-06d4-47e6-a1db-6017b2a618c8 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-changed-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:44 user nova-compute[70914]: DEBUG nova.compute.manager [req-854973cd-e2f4-42ce-ae3a-ed312e7ce718 req-c48ae175-06d4-47e6-a1db-6017b2a618c8 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Refreshing instance network info cache due to event network-changed-6ce0387e-c296-41be-b5e6-9d5ab538cec8. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:53:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-854973cd-e2f4-42ce-ae3a-ed312e7ce718 req-c48ae175-06d4-47e6-a1db-6017b2a618c8 service nova] Acquiring lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:53:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updating instance_info_cache with network_info: [{"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:53:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Releasing lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:53:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:53:45 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Creating image(s)
Jul 27 13:53:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "/opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "/opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "/opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:45 user nova-compute[70914]: DEBUG nova.objects.instance [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-854973cd-e2f4-42ce-ae3a-ed312e7ce718 req-c48ae175-06d4-47e6-a1db-6017b2a618c8 service nova] Acquired lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:53:45 user nova-compute[70914]: DEBUG nova.network.neutron [req-854973cd-e2f4-42ce-ae3a-ed312e7ce718 req-c48ae175-06d4-47e6-a1db-6017b2a618c8 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Refreshing network info cache for port 6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:53:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff.part --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-1f155d2b-2797-4dc6-9cd0-17f9a37e1e28 req-16faa781-3b62-41de-8666-bbfaab9421bf service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f155d2b-2797-4dc6-9cd0-17f9a37e1e28 req-16faa781-3b62-41de-8666-bbfaab9421bf service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f155d2b-2797-4dc6-9cd0-17f9a37e1e28 req-16faa781-3b62-41de-8666-bbfaab9421bf service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f155d2b-2797-4dc6-9cd0-17f9a37e1e28 req-16faa781-3b62-41de-8666-bbfaab9421bf service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-1f155d2b-2797-4dc6-9cd0-17f9a37e1e28 req-16faa781-3b62-41de-8666-bbfaab9421bf service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:53:46 user nova-compute[70914]: WARNING nova.compute.manager [req-1f155d2b-2797-4dc6-9cd0-17f9a37e1e28 req-16faa781-3b62-41de-8666-bbfaab9421bf service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state active and task_state rescuing.
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for fc2a646b-4612-44e3-b2c2-6c53fc65eef1 due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466025.7389214, fc2a646b-4612-44e3-b2c2-6c53fc65eef1 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:53:46 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] VM Resumed (Lifecycle Event)
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4c3c8a80-a514-4417-abb8-813d98d149a2 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:53:46 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466025.7391453, fc2a646b-4612-44e3-b2c2-6c53fc65eef1 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:53:46 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] VM Started (Lifecycle Event)
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff.part --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.virt.images [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] e3901ba8-6c1d-4585-8656-564c8feb3200 was qcow2, converting to raw {{(pid=70914) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff.part /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff.converted {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff.part /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff.converted" returned: 0 in 0.219s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff.converted --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-854973cd-e2f4-42ce-ae3a-ed312e7ce718 req-c48ae175-06d4-47e6-a1db-6017b2a618c8 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updated VIF entry in instance network info cache for port 6ce0387e-c296-41be-b5e6-9d5ab538cec8. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-854973cd-e2f4-42ce-ae3a-ed312e7ce718 req-c48ae175-06d4-47e6-a1db-6017b2a618c8 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updating instance_info_cache with network_info: [{"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:53:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-854973cd-e2f4-42ce-ae3a-ed312e7ce718 req-c48ae175-06d4-47e6-a1db-6017b2a618c8 service nova] Releasing lock "refresh_cache-8377b22e-d359-47c3-bd2d-8b008b35a042" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.538s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff,backing_fmt=raw /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff,backing_fmt=raw /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk 1073741824" returned: 0 in 0.051s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG nova.objects.instance [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'migration_context' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:47 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Rebasing disk image.
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d -F raw /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:48 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466013.806762, 814e062c-85d1-486b-8c7e-9198fbfc5f63 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:53:48 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] VM Stopped (Lifecycle Event)
Jul 27 13:53:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-727f3a54-1edd-4266-a210-1002f458d2a9 None None] [instance: 814e062c-85d1-486b-8c7e-9198fbfc5f63] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d -F raw /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk" returned: 0 in 2.208s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Ensure instance console log exists: /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Start _get_guest_xml network_info=[{"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='eae1d6d858b62678275fe3911a3024b3',container_format='bare',created_at=2023-07-27T13:51:49Z,direct_url=<?>,disk_format='qcow2',id=e3901ba8-6c1d-4585-8656-564c8feb3200,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1517703466-shelved',owner='30c132beeb2d43b1b568da4492f2ffc9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T13:51:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:53:49 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:53:49 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='eae1d6d858b62678275fe3911a3024b3',container_format='bare',created_at=2023-07-27T13:51:49Z,direct_url=<?>,disk_format='qcow2',id=e3901ba8-6c1d-4585-8656-564c8feb3200,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1517703466-shelved',owner='30c132beeb2d43b1b568da4492f2ffc9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T13:51:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.objects.instance [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1517703466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1517703466',id=35,image_ref='e3901ba8-6c1d-4585-8656-564c8feb3200',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1401762589',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-8k9aidcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member',shelved_at='2023-07-27T13:51:53.433299',shelved_host='user',shelved_image_id='e3901ba8-6c1d-4585-8656-564c8feb3200'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=8377b22e-d359-47c3-bd2d-8b008b35a042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.objects.instance [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'pci_devices' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:53:49 user nova-compute[70914]:   <uuid>8377b22e-d359-47c3-bd2d-8b008b35a042</uuid>
Jul 27 13:53:49 user nova-compute[70914]:   <name>instance-00000023</name>
Jul 27 13:53:49 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:53:49 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:53:49 user nova-compute[70914]:   <metadata>
Jul 27 13:53:49 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:53:49 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:53:49 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1517703466</nova:name>
Jul 27 13:53:49 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:53:49</nova:creationTime>
Jul 27 13:53:49 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:53:49 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:53:49 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:53:49 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:53:49 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:53:49 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:53:49 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:53:49 user nova-compute[70914]:       <nova:owner>
Jul 27 13:53:49 user nova-compute[70914]:         <nova:user uuid="ce42c397b5d44afd9c12497b2bf40fb5">tempest-AttachVolumeShelveTestJSON-90363656-project-member</nova:user>
Jul 27 13:53:49 user nova-compute[70914]:         <nova:project uuid="30c132beeb2d43b1b568da4492f2ffc9">tempest-AttachVolumeShelveTestJSON-90363656</nova:project>
Jul 27 13:53:49 user nova-compute[70914]:       </nova:owner>
Jul 27 13:53:49 user nova-compute[70914]:       <nova:root type="image" uuid="e3901ba8-6c1d-4585-8656-564c8feb3200"/>
Jul 27 13:53:49 user nova-compute[70914]:       <nova:ports>
Jul 27 13:53:49 user nova-compute[70914]:         <nova:port uuid="6ce0387e-c296-41be-b5e6-9d5ab538cec8">
Jul 27 13:53:49 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 13:53:49 user nova-compute[70914]:         </nova:port>
Jul 27 13:53:49 user nova-compute[70914]:       </nova:ports>
Jul 27 13:53:49 user nova-compute[70914]:     </nova:instance>
Jul 27 13:53:49 user nova-compute[70914]:   </metadata>
Jul 27 13:53:49 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:53:49 user nova-compute[70914]:     <system>
Jul 27 13:53:49 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:53:49 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:53:49 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:53:49 user nova-compute[70914]:       <entry name="serial">8377b22e-d359-47c3-bd2d-8b008b35a042</entry>
Jul 27 13:53:49 user nova-compute[70914]:       <entry name="uuid">8377b22e-d359-47c3-bd2d-8b008b35a042</entry>
Jul 27 13:53:49 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:53:49 user nova-compute[70914]:     </system>
Jul 27 13:53:49 user nova-compute[70914]:   </sysinfo>
Jul 27 13:53:49 user nova-compute[70914]:   <os>
Jul 27 13:53:49 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:53:49 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:53:49 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:53:49 user nova-compute[70914]:   </os>
Jul 27 13:53:49 user nova-compute[70914]:   <features>
Jul 27 13:53:49 user nova-compute[70914]:     <acpi/>
Jul 27 13:53:49 user nova-compute[70914]:     <apic/>
Jul 27 13:53:49 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:53:49 user nova-compute[70914]:   </features>
Jul 27 13:53:49 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:53:49 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:53:49 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:53:49 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:53:49 user nova-compute[70914]:   </clock>
Jul 27 13:53:49 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:53:49 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:53:49 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:53:49 user nova-compute[70914]:   </cpu>
Jul 27 13:53:49 user nova-compute[70914]:   <devices>
Jul 27 13:53:49 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:53:49 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:53:49 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk"/>
Jul 27 13:53:49 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:53:49 user nova-compute[70914]:     </disk>
Jul 27 13:53:49 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:53:49 user nova-compute[70914]:       <mac address="fa:16:3e:f9:cf:c1"/>
Jul 27 13:53:49 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:53:49 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:53:49 user nova-compute[70914]:       <target dev="tap6ce0387e-c2"/>
Jul 27 13:53:49 user nova-compute[70914]:     </interface>
Jul 27 13:53:49 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:53:49 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/console.log" append="off"/>
Jul 27 13:53:49 user nova-compute[70914]:     </serial>
Jul 27 13:53:49 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:53:49 user nova-compute[70914]:     <video>
Jul 27 13:53:49 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:53:49 user nova-compute[70914]:     </video>
Jul 27 13:53:49 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:53:49 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:53:49 user nova-compute[70914]:     </rng>
Jul 27 13:53:49 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:53:49 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:53:49 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:53:49 user nova-compute[70914]:     </memballoon>
Jul 27 13:53:49 user nova-compute[70914]:   </devices>
Jul 27 13:53:49 user nova-compute[70914]: </domain>
Jul 27 13:53:49 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1517703466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1517703466',id=35,image_ref='e3901ba8-6c1d-4585-8656-564c8feb3200',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1401762589',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-8k9aidcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member',shelved_at='2023-07-27T13:51:53.433299',shelved_host='user',shelved_image_id='e3901ba8-6c1d-4585-8656-564c8feb3200'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=8377b22e-d359-47c3-bd2d-8b008b35a042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG os_vif [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ce0387e-c2, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ce0387e-c2, col_values=(('external_ids', {'iface-id': '6ce0387e-c296-41be-b5e6-9d5ab538cec8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:cf:c1', 'vm-uuid': '8377b22e-d359-47c3-bd2d-8b008b35a042'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:53:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:49 user nova-compute[70914]: INFO os_vif [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2')
Jul 27 13:53:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:53:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] No VIF found with MAC fa:16:3e:f9:cf:c1, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:53:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:51 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-afe5c410-13af-44a5-a171-d82d82c380ee req-3ab58b1e-c825-44ae-905a-8dfb559ce86d service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-afe5c410-13af-44a5-a171-d82d82c380ee req-3ab58b1e-c825-44ae-905a-8dfb559ce86d service nova] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-afe5c410-13af-44a5-a171-d82d82c380ee req-3ab58b1e-c825-44ae-905a-8dfb559ce86d service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-afe5c410-13af-44a5-a171-d82d82c380ee req-3ab58b1e-c825-44ae-905a-8dfb559ce86d service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:51 user nova-compute[70914]: DEBUG nova.compute.manager [req-afe5c410-13af-44a5-a171-d82d82c380ee req-3ab58b1e-c825-44ae-905a-8dfb559ce86d service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] No waiting events found dispatching network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:53:51 user nova-compute[70914]: WARNING nova.compute.manager [req-afe5c410-13af-44a5-a171-d82d82c380ee req-3ab58b1e-c825-44ae-905a-8dfb559ce86d service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received unexpected event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 13:53:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466033.8077612, 8377b22e-d359-47c3-bd2d-8b008b35a042 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:53:53 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] VM Resumed (Lifecycle Event)
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:53:53 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance spawned successfully.
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-2cef43fa-5e06-427b-a518-6db124f4a69d req-ba0d988e-0924-49d4-a3b6-f9178914bcc4 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2cef43fa-5e06-427b-a518-6db124f4a69d req-ba0d988e-0924-49d4-a3b6-f9178914bcc4 service nova] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2cef43fa-5e06-427b-a518-6db124f4a69d req-ba0d988e-0924-49d4-a3b6-f9178914bcc4 service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2cef43fa-5e06-427b-a518-6db124f4a69d req-ba0d988e-0924-49d4-a3b6-f9178914bcc4 service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-2cef43fa-5e06-427b-a518-6db124f4a69d req-ba0d988e-0924-49d4-a3b6-f9178914bcc4 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] No waiting events found dispatching network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:53:53 user nova-compute[70914]: WARNING nova.compute.manager [req-2cef43fa-5e06-427b-a518-6db124f4a69d req-ba0d988e-0924-49d4-a3b6-f9178914bcc4 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received unexpected event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:53:53 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466033.8227644, 8377b22e-d359-47c3-bd2d-8b008b35a042 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:53:53 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] VM Started (Lifecycle Event)
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466018.9625378, 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:53:53 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] VM Stopped (Lifecycle Event)
Jul 27 13:53:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b1a702b4-4ee1-4256-93ff-658782691a6e None None] [instance: 2e5a3cf8-9c1d-4d2e-b242-cd4b603e8f12] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:53:54 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:53:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:53:54 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:53:54 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8291MB free_disk=25.01662826538086GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-2ea8e289-8c79-4e73-9aae-aa1713a84fb3 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.335s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cd4b9913-ab18-42d7-abd7-c4dad48375c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance fc2a646b-4612-44e3-b2c2-6c53fc65eef1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (28f9fcbc-7a25-483f-af71-8564174ecae0): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1751}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:53:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:55 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:55 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:55 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:53:57 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:53:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:53:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:53:57 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:53:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:53:58 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updating instance_info_cache with network_info: [{"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:53:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:53:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:53:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:53:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:01 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:54:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "e595326a-2178-48d1-ba18-a703a76c23b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:54:23 user nova-compute[70914]: INFO nova.compute.claims [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Claim successful on node user
Jul 27 13:54:23 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG nova.network.neutron [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:54:23 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:54:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:54:23 user nova-compute[70914]: INFO nova.virt.block_device [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Booting with volume 389ab7c2-1b59-4a14-955a-96eeb8f764b0 at /dev/vda
Jul 27 13:54:23 user nova-compute[70914]: DEBUG os_brick.utils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3794f90c-eb83-46cc-b473-1460bf36cb8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc3626-1300-49be-82b0-5c4b4d8632a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d826d5-a34a-4a23-874b-f053d5c88692]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce208a6-afe7-4e55-892f-dfedf64c2ce3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:54:23 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:54:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b8a5bd-8110-4715-a164-f4f86969a408]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG os_brick.utils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating existing volume attachment record: e22ff720-f157-4abe-8fc4-a33b2f6313f5 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:54:23 user nova-compute[70914]: DEBUG nova.policy [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc9d168610c040b9b7931474e241c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc9d12d3f5942cc978d1b3636c29335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:54:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:24 user nova-compute[70914]: DEBUG nova.network.neutron [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Successfully created port: 1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG nova.network.neutron [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Successfully updated port: 1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquired lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG nova.network.neutron [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-f91f217c-ff72-4f72-bb10-0d1d90286a83 req-f43575ce-ffba-4a7d-a6fa-143c53cfedf6 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-changed-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-f91f217c-ff72-4f72-bb10-0d1d90286a83 req-f43575ce-ffba-4a7d-a6fa-143c53cfedf6 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Refreshing instance network info cache due to event network-changed-1a00fbed-0a5c-49d1-800a-238f198d6411. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f91f217c-ff72-4f72-bb10-0d1d90286a83 req-f43575ce-ffba-4a7d-a6fa-143c53cfedf6 service nova] Acquiring lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG nova.network.neutron [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG nova.network.neutron [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating instance_info_cache with network_info: [{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Releasing lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Instance network_info: |[{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f91f217c-ff72-4f72-bb10-0d1d90286a83 req-f43575ce-ffba-4a7d-a6fa-143c53cfedf6 service nova] Acquired lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:54:25 user nova-compute[70914]: DEBUG nova.network.neutron [req-f91f217c-ff72-4f72-bb10-0d1d90286a83 req-f43575ce-ffba-4a7d-a6fa-143c53cfedf6 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Refreshing network info cache for port 1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:54:26 user nova-compute[70914]: DEBUG nova.network.neutron [req-f91f217c-ff72-4f72-bb10-0d1d90286a83 req-f43575ce-ffba-4a7d-a6fa-143c53cfedf6 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updated VIF entry in instance network info cache for port 1a00fbed-0a5c-49d1-800a-238f198d6411. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:54:26 user nova-compute[70914]: DEBUG nova.network.neutron [req-f91f217c-ff72-4f72-bb10-0d1d90286a83 req-f43575ce-ffba-4a7d-a6fa-143c53cfedf6 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating instance_info_cache with network_info: [{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:54:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f91f217c-ff72-4f72-bb10-0d1d90286a83 req-f43575ce-ffba-4a7d-a6fa-143c53cfedf6 service nova] Releasing lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:54:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.compute.manager [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:54:31 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Creating image(s)
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Ensure instance console log exists: /opt/stack/data/nova/instances/e595326a-2178-48d1-ba18-a703a76c23b9/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Start _get_guest_xml network_info=[{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'e22ff720-f157-4abe-8fc4-a33b2f6313f5', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxOPtmKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e595326a-2178-48d1-ba18-a703a76c23b9', 'attached_at': '', 'detached_at': '', 'volume_id': '389ab7c2-1b59-4a14-955a-96eeb8f764b0', 'serial': '389ab7c2-1b59-4a14-955a-96eeb8f764b0'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:54:31 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:54:31 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxOPtmKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:54:31 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:54:31 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:54:31 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[479b1fb7-cc7b-47ec-8050-80843ea79a7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:54:31 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f34e9d8-9cac-4319-8ce7-7532b63823c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0] added
Jul 27 13:54:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3d52d7-3072-4af4-9a65-f4936910adfe]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acaf426-7a67-4a5f-bff9-7cb694a237d1]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxOPtmKp {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxOPtmKp" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b08bf2-d0d9-40f5-9e3d-5e18bb173688]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FxOPtmKp'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[25138ca3-0896-4bb6-891b-ee72e5d5a97d]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[797489be-476a-4664-8db7-ed318ba90270]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:54:31 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:54:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:54:31 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:54:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1d12f4-1199-41a7-8f6a-c879535e676a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260]
Jul 27 13:54:31 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260] successful.
Jul 27 13:54:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce522629-edde-4af2-b034-ff795eb8ca00]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9896b6cd-b612-4398-b746-c167a56e101d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:54:31 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:54:31 user nova-compute[70914]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:54:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:54:31 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:54:31 user nova-compute[70914]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:54:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b70e4d-57c1-4d77-a35d-f51948ed59b9]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxOPtmKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:54:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23834376534383537', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834376534383537', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-258381433',display_name='tempest-TestShelveInstance-server-258381433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-258381433',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWePivK+ohgjpS7ULQzMfaCzLUyr/7CHWKxilUPtHxYrRlp72yp93hD1Z5eSxIa4WP8mEJqldom5IIAc+OdNMzBZHqjbe9xt5xD6TsxEiBwtF+4H4rTwdUm8eS/uyZT/g==',key_name='tempest-TestShelveInstance-597209222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fc9d12d3f5942cc978d1b3636c29335',ramdisk_id='',reservation_id='r-g9ugvfau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1359726663',owner_user_name='tempest-TestShelveInstance-1359726663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:54:23Z,user_data=None,user_id='bc9d168610c040b9b7931474e241c3f6',uuid=e595326a-2178-48d1-ba18-a703a76c23b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converting VIF {"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.objects.instance [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lazy-loading 'pci_devices' on Instance uuid e595326a-2178-48d1-ba18-a703a76c23b9 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:54:32 user nova-compute[70914]:   <uuid>e595326a-2178-48d1-ba18-a703a76c23b9</uuid>
Jul 27 13:54:32 user nova-compute[70914]:   <name>instance-00000025</name>
Jul 27 13:54:32 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:54:32 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:54:32 user nova-compute[70914]:   <metadata>
Jul 27 13:54:32 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:54:32 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:54:32 user nova-compute[70914]:       <nova:name>tempest-TestShelveInstance-server-258381433</nova:name>
Jul 27 13:54:32 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:54:31</nova:creationTime>
Jul 27 13:54:32 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:54:32 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:54:32 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:54:32 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:54:32 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:54:32 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:54:32 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:54:32 user nova-compute[70914]:       <nova:owner>
Jul 27 13:54:32 user nova-compute[70914]:         <nova:user uuid="bc9d168610c040b9b7931474e241c3f6">tempest-TestShelveInstance-1359726663-project-member</nova:user>
Jul 27 13:54:32 user nova-compute[70914]:         <nova:project uuid="5fc9d12d3f5942cc978d1b3636c29335">tempest-TestShelveInstance-1359726663</nova:project>
Jul 27 13:54:32 user nova-compute[70914]:       </nova:owner>
Jul 27 13:54:32 user nova-compute[70914]:       <nova:ports>
Jul 27 13:54:32 user nova-compute[70914]:         <nova:port uuid="1a00fbed-0a5c-49d1-800a-238f198d6411">
Jul 27 13:54:32 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 13:54:32 user nova-compute[70914]:         </nova:port>
Jul 27 13:54:32 user nova-compute[70914]:       </nova:ports>
Jul 27 13:54:32 user nova-compute[70914]:     </nova:instance>
Jul 27 13:54:32 user nova-compute[70914]:   </metadata>
Jul 27 13:54:32 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:54:32 user nova-compute[70914]:     <system>
Jul 27 13:54:32 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:54:32 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:54:32 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:54:32 user nova-compute[70914]:       <entry name="serial">e595326a-2178-48d1-ba18-a703a76c23b9</entry>
Jul 27 13:54:32 user nova-compute[70914]:       <entry name="uuid">e595326a-2178-48d1-ba18-a703a76c23b9</entry>
Jul 27 13:54:32 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:54:32 user nova-compute[70914]:     </system>
Jul 27 13:54:32 user nova-compute[70914]:   </sysinfo>
Jul 27 13:54:32 user nova-compute[70914]:   <os>
Jul 27 13:54:32 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:54:32 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:54:32 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:54:32 user nova-compute[70914]:   </os>
Jul 27 13:54:32 user nova-compute[70914]:   <features>
Jul 27 13:54:32 user nova-compute[70914]:     <acpi/>
Jul 27 13:54:32 user nova-compute[70914]:     <apic/>
Jul 27 13:54:32 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:54:32 user nova-compute[70914]:   </features>
Jul 27 13:54:32 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:54:32 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:54:32 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:54:32 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:54:32 user nova-compute[70914]:   </clock>
Jul 27 13:54:32 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:54:32 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:54:32 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:54:32 user nova-compute[70914]:   </cpu>
Jul 27 13:54:32 user nova-compute[70914]:   <devices>
Jul 27 13:54:32 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:54:32 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:54:32 user nova-compute[70914]:       <source dev="/dev/sdb"/>
Jul 27 13:54:32 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:54:32 user nova-compute[70914]:       <serial>389ab7c2-1b59-4a14-955a-96eeb8f764b0</serial>
Jul 27 13:54:32 user nova-compute[70914]:     </disk>
Jul 27 13:54:32 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:54:32 user nova-compute[70914]:       <mac address="fa:16:3e:92:8e:d3"/>
Jul 27 13:54:32 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:54:32 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:54:32 user nova-compute[70914]:       <target dev="tap1a00fbed-0a"/>
Jul 27 13:54:32 user nova-compute[70914]:     </interface>
Jul 27 13:54:32 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:54:32 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/e595326a-2178-48d1-ba18-a703a76c23b9/console.log" append="off"/>
Jul 27 13:54:32 user nova-compute[70914]:     </serial>
Jul 27 13:54:32 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:54:32 user nova-compute[70914]:     <video>
Jul 27 13:54:32 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:54:32 user nova-compute[70914]:     </video>
Jul 27 13:54:32 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:54:32 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:54:32 user nova-compute[70914]:     </rng>
Jul 27 13:54:32 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:54:32 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:54:32 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:54:32 user nova-compute[70914]:     </memballoon>
Jul 27 13:54:32 user nova-compute[70914]:   </devices>
Jul 27 13:54:32 user nova-compute[70914]: </domain>
Jul 27 13:54:32 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-258381433',display_name='tempest-TestShelveInstance-server-258381433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-258381433',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWePivK+ohgjpS7ULQzMfaCzLUyr/7CHWKxilUPtHxYrRlp72yp93hD1Z5eSxIa4WP8mEJqldom5IIAc+OdNMzBZHqjbe9xt5xD6TsxEiBwtF+4H4rTwdUm8eS/uyZT/g==',key_name='tempest-TestShelveInstance-597209222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fc9d12d3f5942cc978d1b3636c29335',ramdisk_id='',reservation_id='r-g9ugvfau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1359726663',owner_user_name='tempest-TestShelveInstance-1359726663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:54:23Z,user_data=None,user_id='bc9d168610c040b9b7931474e241c3f6',uuid=e595326a-2178-48d1-ba18-a703a76c23b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converting VIF {"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG os_vif [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a00fbed-0a, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a00fbed-0a, col_values=(('external_ids', {'iface-id': '1a00fbed-0a5c-49d1-800a-238f198d6411', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:8e:d3', 'vm-uuid': 'e595326a-2178-48d1-ba18-a703a76c23b9'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:32 user nova-compute[70914]: INFO os_vif [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a')
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:54:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] No VIF found with MAC fa:16:3e:92:8e:d3, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:54:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-fbfd8e64-d2ac-4b3f-80ed-a338c572f02d req-e7890fd5-4386-48d0-9b93-2bb2597fa3c2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fbfd8e64-d2ac-4b3f-80ed-a338c572f02d req-e7890fd5-4386-48d0-9b93-2bb2597fa3c2 service nova] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fbfd8e64-d2ac-4b3f-80ed-a338c572f02d req-e7890fd5-4386-48d0-9b93-2bb2597fa3c2 service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fbfd8e64-d2ac-4b3f-80ed-a338c572f02d req-e7890fd5-4386-48d0-9b93-2bb2597fa3c2 service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-fbfd8e64-d2ac-4b3f-80ed-a338c572f02d req-e7890fd5-4386-48d0-9b93-2bb2597fa3c2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] No waiting events found dispatching network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:54:34 user nova-compute[70914]: WARNING nova.compute.manager [req-fbfd8e64-d2ac-4b3f-80ed-a338c572f02d req-e7890fd5-4386-48d0-9b93-2bb2597fa3c2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received unexpected event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 for instance with vm_state building and task_state spawning.
Jul 27 13:54:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:35 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466075.9952555, e595326a-2178-48d1-ba18-a703a76c23b9 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:54:35 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] VM Resumed (Lifecycle Event)
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:54:36 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Instance spawned successfully.
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466075.9955335, e595326a-2178-48d1-ba18-a703a76c23b9 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:54:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] VM Started (Lifecycle Event)
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:54:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:54:36 user nova-compute[70914]: INFO nova.compute.manager [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Took 5.07 seconds to spawn the instance on the hypervisor.
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:54:36 user nova-compute[70914]: INFO nova.compute.manager [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Took 13.24 seconds to build instance.
Jul 27 13:54:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-818dc08a-4bd9-4114-bb02-9db00bd819fb tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "e595326a-2178-48d1-ba18-a703a76c23b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.358s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-c40deed8-3ffd-4bcd-a0db-ae15811e721c req-9e5dc04b-b0af-4e99-a8b0-56fe6a6586dc service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c40deed8-3ffd-4bcd-a0db-ae15811e721c req-9e5dc04b-b0af-4e99-a8b0-56fe6a6586dc service nova] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c40deed8-3ffd-4bcd-a0db-ae15811e721c req-9e5dc04b-b0af-4e99-a8b0-56fe6a6586dc service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c40deed8-3ffd-4bcd-a0db-ae15811e721c req-9e5dc04b-b0af-4e99-a8b0-56fe6a6586dc service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-c40deed8-3ffd-4bcd-a0db-ae15811e721c req-9e5dc04b-b0af-4e99-a8b0-56fe6a6586dc service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] No waiting events found dispatching network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:54:36 user nova-compute[70914]: WARNING nova.compute.manager [req-c40deed8-3ffd-4bcd-a0db-ae15811e721c req-9e5dc04b-b0af-4e99-a8b0-56fe6a6586dc service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received unexpected event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 for instance with vm_state active and task_state None.
Jul 27 13:54:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:54:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:40 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:54:40 user nova-compute[70914]: INFO nova.compute.claims [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Claim successful on node user
Jul 27 13:54:41 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG nova.network.neutron [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:54:41 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:54:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:54:41 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Creating image(s)
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "/opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "/opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG nova.policy [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39c9278ea5d24d2a9182c20bcb32febb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8032e7912884d3bb9a66632f95137ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk 1073741824" returned: 0 in 0.054s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.161s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Cannot resize image /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG nova.objects.instance [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'migration_context' on Instance uuid b5734110-eb9c-4ba8-af64-351e5c8b59ef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Ensure instance console log exists: /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:42 user nova-compute[70914]: DEBUG nova.network.neutron [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Successfully created port: 509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Successfully updated port: 509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquired lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.compute.manager [req-1f8bcf68-80de-4214-904b-d3d15287ec58 req-27f0918a-e571-48bd-9734-54855fcc9184 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received event network-changed-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.compute.manager [req-1f8bcf68-80de-4214-904b-d3d15287ec58 req-27f0918a-e571-48bd-9734-54855fcc9184 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Refreshing instance network info cache due to event network-changed-509f9e28-206a-4400-9e8f-a5895875961b. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f8bcf68-80de-4214-904b-d3d15287ec58 req-27f0918a-e571-48bd-9734-54855fcc9184 service nova] Acquiring lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.network.neutron [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Updating instance_info_cache with network_info: [{"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Releasing lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.compute.manager [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Instance network_info: |[{"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f8bcf68-80de-4214-904b-d3d15287ec58 req-27f0918a-e571-48bd-9734-54855fcc9184 service nova] Acquired lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.network.neutron [req-1f8bcf68-80de-4214-904b-d3d15287ec58 req-27f0918a-e571-48bd-9734-54855fcc9184 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Refreshing network info cache for port 509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Start _get_guest_xml network_info=[{"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:54:43 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:54:43 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:54:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1498292459',display_name='tempest-AttachVolumeNegativeTest-server-1498292459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1498292459',id=38,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALvjFB0ClV4UcUlMvQpPWX/FHv8pybq83fkhfpkUqGOT6puiQ5tGxi6AIuWXcfRrYmbmAJhEDOBLmgXP5LENCF/FTrY199UEe6kQUZjWFeBsZcvUbrHpKIyGfBXRl/eCw==',key_name='tempest-keypair-1429246869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-sqse7ikc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=b5734110-eb9c-4ba8-af64-351e5c8b59ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:de:65,bridge_name='br-int',has_traffic_filtering=True,id=509f9e28-206a-4400-9e8f-a5895875961b,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509f9e28-20') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.objects.instance [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'pci_devices' on Instance uuid b5734110-eb9c-4ba8-af64-351e5c8b59ef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:54:43 user nova-compute[70914]:   <uuid>b5734110-eb9c-4ba8-af64-351e5c8b59ef</uuid>
Jul 27 13:54:43 user nova-compute[70914]:   <name>instance-00000026</name>
Jul 27 13:54:43 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:54:43 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:54:43 user nova-compute[70914]:   <metadata>
Jul 27 13:54:43 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:54:43 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:54:43 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1498292459</nova:name>
Jul 27 13:54:43 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:54:43</nova:creationTime>
Jul 27 13:54:43 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:54:43 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:54:43 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:54:43 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:54:43 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:54:43 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:54:43 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:54:43 user nova-compute[70914]:       <nova:owner>
Jul 27 13:54:43 user nova-compute[70914]:         <nova:user uuid="39c9278ea5d24d2a9182c20bcb32febb">tempest-AttachVolumeNegativeTest-431364948-project-member</nova:user>
Jul 27 13:54:43 user nova-compute[70914]:         <nova:project uuid="f8032e7912884d3bb9a66632f95137ad">tempest-AttachVolumeNegativeTest-431364948</nova:project>
Jul 27 13:54:43 user nova-compute[70914]:       </nova:owner>
Jul 27 13:54:43 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:54:43 user nova-compute[70914]:       <nova:ports>
Jul 27 13:54:43 user nova-compute[70914]:         <nova:port uuid="509f9e28-206a-4400-9e8f-a5895875961b">
Jul 27 13:54:43 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 13:54:43 user nova-compute[70914]:         </nova:port>
Jul 27 13:54:43 user nova-compute[70914]:       </nova:ports>
Jul 27 13:54:43 user nova-compute[70914]:     </nova:instance>
Jul 27 13:54:43 user nova-compute[70914]:   </metadata>
Jul 27 13:54:43 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:54:43 user nova-compute[70914]:     <system>
Jul 27 13:54:43 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:54:43 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:54:43 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:54:43 user nova-compute[70914]:       <entry name="serial">b5734110-eb9c-4ba8-af64-351e5c8b59ef</entry>
Jul 27 13:54:43 user nova-compute[70914]:       <entry name="uuid">b5734110-eb9c-4ba8-af64-351e5c8b59ef</entry>
Jul 27 13:54:43 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:54:43 user nova-compute[70914]:     </system>
Jul 27 13:54:43 user nova-compute[70914]:   </sysinfo>
Jul 27 13:54:43 user nova-compute[70914]:   <os>
Jul 27 13:54:43 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:54:43 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:54:43 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:54:43 user nova-compute[70914]:   </os>
Jul 27 13:54:43 user nova-compute[70914]:   <features>
Jul 27 13:54:43 user nova-compute[70914]:     <acpi/>
Jul 27 13:54:43 user nova-compute[70914]:     <apic/>
Jul 27 13:54:43 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:54:43 user nova-compute[70914]:   </features>
Jul 27 13:54:43 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:54:43 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:54:43 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:54:43 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:54:43 user nova-compute[70914]:   </clock>
Jul 27 13:54:43 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:54:43 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:54:43 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:54:43 user nova-compute[70914]:   </cpu>
Jul 27 13:54:43 user nova-compute[70914]:   <devices>
Jul 27 13:54:43 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:54:43 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:54:43 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk"/>
Jul 27 13:54:43 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:54:43 user nova-compute[70914]:     </disk>
Jul 27 13:54:43 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:54:43 user nova-compute[70914]:       <mac address="fa:16:3e:5a:de:65"/>
Jul 27 13:54:43 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:54:43 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:54:43 user nova-compute[70914]:       <target dev="tap509f9e28-20"/>
Jul 27 13:54:43 user nova-compute[70914]:     </interface>
Jul 27 13:54:43 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:54:43 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/console.log" append="off"/>
Jul 27 13:54:43 user nova-compute[70914]:     </serial>
Jul 27 13:54:43 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:54:43 user nova-compute[70914]:     <video>
Jul 27 13:54:43 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:54:43 user nova-compute[70914]:     </video>
Jul 27 13:54:43 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:54:43 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:54:43 user nova-compute[70914]:     </rng>
Jul 27 13:54:43 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:54:43 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:54:43 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:54:43 user nova-compute[70914]:     </memballoon>
Jul 27 13:54:43 user nova-compute[70914]:   </devices>
Jul 27 13:54:43 user nova-compute[70914]: </domain>
Jul 27 13:54:43 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:54:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1498292459',display_name='tempest-AttachVolumeNegativeTest-server-1498292459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1498292459',id=38,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALvjFB0ClV4UcUlMvQpPWX/FHv8pybq83fkhfpkUqGOT6puiQ5tGxi6AIuWXcfRrYmbmAJhEDOBLmgXP5LENCF/FTrY199UEe6kQUZjWFeBsZcvUbrHpKIyGfBXRl/eCw==',key_name='tempest-keypair-1429246869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-sqse7ikc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=b5734110-eb9c-4ba8-af64-351e5c8b59ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:de:65,bridge_name='br-int',has_traffic_filtering=True,id=509f9e28-206a-4400-9e8f-a5895875961b,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509f9e28-20') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG os_vif [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:de:65,bridge_name='br-int',has_traffic_filtering=True,id=509f9e28-206a-4400-9e8f-a5895875961b,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509f9e28-20') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap509f9e28-20, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap509f9e28-20, col_values=(('external_ids', {'iface-id': '509f9e28-206a-4400-9e8f-a5895875961b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:de:65', 'vm-uuid': 'b5734110-eb9c-4ba8-af64-351e5c8b59ef'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:43 user nova-compute[70914]: INFO os_vif [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:de:65,bridge_name='br-int',has_traffic_filtering=True,id=509f9e28-206a-4400-9e8f-a5895875961b,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509f9e28-20')
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:54:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No VIF found with MAC fa:16:3e:5a:de:65, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:54:44 user nova-compute[70914]: DEBUG nova.network.neutron [req-1f8bcf68-80de-4214-904b-d3d15287ec58 req-27f0918a-e571-48bd-9734-54855fcc9184 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Updated VIF entry in instance network info cache for port 509f9e28-206a-4400-9e8f-a5895875961b. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:54:44 user nova-compute[70914]: DEBUG nova.network.neutron [req-1f8bcf68-80de-4214-904b-d3d15287ec58 req-27f0918a-e571-48bd-9734-54855fcc9184 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Updating instance_info_cache with network_info: [{"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:54:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1f8bcf68-80de-4214-904b-d3d15287ec58 req-27f0918a-e571-48bd-9734-54855fcc9184 service nova] Releasing lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:54:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG nova.compute.manager [req-dfe31fa1-8406-4d88-a706-f1d4cd526664 req-6b466998-51da-4df3-b424-0f1370fa6b34 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received event network-vif-plugged-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dfe31fa1-8406-4d88-a706-f1d4cd526664 req-6b466998-51da-4df3-b424-0f1370fa6b34 service nova] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dfe31fa1-8406-4d88-a706-f1d4cd526664 req-6b466998-51da-4df3-b424-0f1370fa6b34 service nova] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dfe31fa1-8406-4d88-a706-f1d4cd526664 req-6b466998-51da-4df3-b424-0f1370fa6b34 service nova] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG nova.compute.manager [req-dfe31fa1-8406-4d88-a706-f1d4cd526664 req-6b466998-51da-4df3-b424-0f1370fa6b34 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] No waiting events found dispatching network-vif-plugged-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:54:45 user nova-compute[70914]: WARNING nova.compute.manager [req-dfe31fa1-8406-4d88-a706-f1d4cd526664 req-6b466998-51da-4df3-b424-0f1370fa6b34 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received unexpected event network-vif-plugged-509f9e28-206a-4400-9e8f-a5895875961b for instance with vm_state building and task_state spawning.
Jul 27 13:54:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466087.5393806, b5734110-eb9c-4ba8-af64-351e5c8b59ef => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:54:47 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] VM Resumed (Lifecycle Event)
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:54:47 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Instance spawned successfully.
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:54:47 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466087.5396833, b5734110-eb9c-4ba8-af64-351e5c8b59ef => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:54:47 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] VM Started (Lifecycle Event)
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:54:47 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:54:47 user nova-compute[70914]: INFO nova.compute.manager [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Took 6.21 seconds to spawn the instance on the hypervisor.
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.compute.manager [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.compute.manager [req-c23b5b77-eb8f-4185-8283-a6157ad8ee8f req-be293458-3604-4208-a589-ca43ed0244d8 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received event network-vif-plugged-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c23b5b77-eb8f-4185-8283-a6157ad8ee8f req-be293458-3604-4208-a589-ca43ed0244d8 service nova] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c23b5b77-eb8f-4185-8283-a6157ad8ee8f req-be293458-3604-4208-a589-ca43ed0244d8 service nova] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c23b5b77-eb8f-4185-8283-a6157ad8ee8f req-be293458-3604-4208-a589-ca43ed0244d8 service nova] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:47 user nova-compute[70914]: DEBUG nova.compute.manager [req-c23b5b77-eb8f-4185-8283-a6157ad8ee8f req-be293458-3604-4208-a589-ca43ed0244d8 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] No waiting events found dispatching network-vif-plugged-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:54:47 user nova-compute[70914]: WARNING nova.compute.manager [req-c23b5b77-eb8f-4185-8283-a6157ad8ee8f req-be293458-3604-4208-a589-ca43ed0244d8 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received unexpected event network-vif-plugged-509f9e28-206a-4400-9e8f-a5895875961b for instance with vm_state building and task_state spawning.
Jul 27 13:54:47 user nova-compute[70914]: INFO nova.compute.manager [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Took 6.94 seconds to build instance.
Jul 27 13:54:47 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-24eaf535-4d3d-47c6-b7f8-3c09e06e428c tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.035s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:51 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:52 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:54:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:54 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:54:54 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:54:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8006MB free_disk=25.145999908447266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cd4b9913-ab18-42d7-abd7-c4dad48375c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance fc2a646b-4612-44e3-b2c2-6c53fc65eef1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8377b22e-d359-47c3-bd2d-8b008b35a042 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e595326a-2178-48d1-ba18-a703a76c23b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance b5734110-eb9c-4ba8-af64-351e5c8b59ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:54:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:54:55 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:54:55 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:54:55 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:54:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:54:56 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:54:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:54:56 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:54:57 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:54:58 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:54:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:54:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-cd4b9913-ab18-42d7-abd7-c4dad48375c6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:54:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-cd4b9913-ab18-42d7-abd7-c4dad48375c6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:54:58 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:54:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:59 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Updating instance_info_cache with network_info: [{"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:54:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-cd4b9913-ab18-42d7-abd7-c4dad48375c6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:54:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:54:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:54:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:55:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:55:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "0d2398d7-3b4a-4543-a606-06efd18f41ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:55:07 user nova-compute[70914]: INFO nova.compute.claims [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Claim successful on node user
Jul 27 13:55:07 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:55:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:55:07 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:55:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:55:07 user nova-compute[70914]: INFO nova.virt.block_device [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Booting with volume snapshot 0f24751c-ae2e-4e37-b5bf-5dd2c714b293 at /dev/vda
Jul 27 13:55:08 user nova-compute[70914]: DEBUG nova.policy [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6161b1cf5fb4d08a8cbd36a93b8400c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ac071233d44fbb62e558725f63ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:55:08 user nova-compute[70914]: DEBUG nova.network.neutron [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Successfully created port: 31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:55:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Successfully updated port: 31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:55:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "refresh_cache-0d2398d7-3b4a-4543-a606-06efd18f41ca" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:55:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquired lock "refresh_cache-0d2398d7-3b4a-4543-a606-06efd18f41ca" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:55:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:55:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-ad7f1b7c-8b42-4cbf-a772-234b6e3f928c req-5d4c61c5-4d7a-4c49-bfe3-2fa484dd7f7b service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Received event network-changed-31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:55:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-ad7f1b7c-8b42-4cbf-a772-234b6e3f928c req-5d4c61c5-4d7a-4c49-bfe3-2fa484dd7f7b service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Refreshing instance network info cache due to event network-changed-31dd19df-5a77-4cc1-973b-dc7602515196. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:55:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ad7f1b7c-8b42-4cbf-a772-234b6e3f928c req-5d4c61c5-4d7a-4c49-bfe3-2fa484dd7f7b service nova] Acquiring lock "refresh_cache-0d2398d7-3b4a-4543-a606-06efd18f41ca" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:55:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:55:10 user nova-compute[70914]: DEBUG nova.network.neutron [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Updating instance_info_cache with network_info: [{"id": "31dd19df-5a77-4cc1-973b-dc7602515196", "address": "fa:16:3e:ea:18:93", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31dd19df-5a", "ovs_interfaceid": "31dd19df-5a77-4cc1-973b-dc7602515196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:55:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Releasing lock "refresh_cache-0d2398d7-3b4a-4543-a606-06efd18f41ca" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:55:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Instance network_info: |[{"id": "31dd19df-5a77-4cc1-973b-dc7602515196", "address": "fa:16:3e:ea:18:93", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31dd19df-5a", "ovs_interfaceid": "31dd19df-5a77-4cc1-973b-dc7602515196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:55:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ad7f1b7c-8b42-4cbf-a772-234b6e3f928c req-5d4c61c5-4d7a-4c49-bfe3-2fa484dd7f7b service nova] Acquired lock "refresh_cache-0d2398d7-3b4a-4543-a606-06efd18f41ca" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:55:10 user nova-compute[70914]: DEBUG nova.network.neutron [req-ad7f1b7c-8b42-4cbf-a772-234b6e3f928c req-5d4c61c5-4d7a-4c49-bfe3-2fa484dd7f7b service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Refreshing network info cache for port 31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:55:10 user nova-compute[70914]: DEBUG nova.network.neutron [req-ad7f1b7c-8b42-4cbf-a772-234b6e3f928c req-5d4c61c5-4d7a-4c49-bfe3-2fa484dd7f7b service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Updated VIF entry in instance network info cache for port 31dd19df-5a77-4cc1-973b-dc7602515196. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:55:10 user nova-compute[70914]: DEBUG nova.network.neutron [req-ad7f1b7c-8b42-4cbf-a772-234b6e3f928c req-5d4c61c5-4d7a-4c49-bfe3-2fa484dd7f7b service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Updating instance_info_cache with network_info: [{"id": "31dd19df-5a77-4cc1-973b-dc7602515196", "address": "fa:16:3e:ea:18:93", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31dd19df-5a", "ovs_interfaceid": "31dd19df-5a77-4cc1-973b-dc7602515196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:55:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ad7f1b7c-8b42-4cbf-a772-234b6e3f928c req-5d4c61c5-4d7a-4c49-bfe3-2fa484dd7f7b service nova] Releasing lock "refresh_cache-0d2398d7-3b4a-4543-a606-06efd18f41ca" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG os_brick.utils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[879dfd18-b378-4157-aa9c-657975c177f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25a9d94-3f2e-4219-b869-2842c63499a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7abf97-57a0-4557-9166-c5243ac3a6c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[216dda59-d77a-483b-a8bd-0c650695736f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:55:13 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:55:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1a0d8b-a194-46fa-914e-2034214a13f3]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG os_brick.utils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Updating existing volume attachment record: d20f09cc-a5ca-416c-846d-48aee63735f8 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:55:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:55:20 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Creating image(s)
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Ensure instance console log exists: /opt/stack/data/nova/instances/0d2398d7-3b4a-4543-a606-06efd18f41ca/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Start _get_guest_xml network_info=[{"id": "31dd19df-5a77-4cc1-973b-dc7602515196", "address": "fa:16:3e:ea:18:93", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31dd19df-5a", "ovs_interfaceid": "31dd19df-5a77-4cc1-973b-dc7602515196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'd20f09cc-a5ca-416c-846d-48aee63735f8', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHnWwIVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0d2398d7-3b4a-4543-a606-06efd18f41ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9b7fe3f-9c62-4d28-a1ca-0070899d8382', 'serial': 'a9b7fe3f-9c62-4d28-a1ca-0070899d8382'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:55:20 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:55:20 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHnWwIVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:55:20 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:55:20 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:55:20 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e34e1d-8441-4132-b48c-96cf148438d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:55:20 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0eed50-5404-4c47-8ce3-5cdbbedc161d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382] added
Jul 27 13:55:20 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[effa6f92-118f-41eb-b820-5a11b9ce0469]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9946e7-23d8-43e1-ad90-127d4d257fab]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHnWwIVP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHnWwIVP" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb80cf72-0898-488e-ba59-f0b72ca4f9cb]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHnWwIVP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e13b50-e7a3-40df-946d-ae1df94a2bfe]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:55:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[271177c2-26c0-4a07-91af-a2375ccbf275]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:55:21 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:55:21 user nova-compute[70914]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:55:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:55:21 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:55:21 user nova-compute[70914]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:55:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[df26344a-7a6e-4c38-adb6-2515f3a492d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382, portal: 172.16.0.220,3260]
Jul 27 13:55:21 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382, portal: 172.16.0.220,3260] successful.
Jul 27 13:55:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a8d19-db91-4bdf-9ba4-c384a758e8e4]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[054e5c8b-3d47-4792-910b-5b7e0d8ecd82]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:55:21 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:55:21 user nova-compute[70914]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:55:21 user nova-compute[70914]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)
Jul 27 13:55:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:55:21 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:55:21 user nova-compute[70914]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:55:21 user nova-compute[70914]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)
Jul 27 13:55:21 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2639e5f2-673d-48b7-9472-0ae72a19d3b0]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:55:21 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHnWwIVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23337393737373532', 'path': '/dev/sdd'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337393737373532', 'path': '/dev/sdd'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-522404271',display_name='tempest-TestVolumeBootPattern-server-522404271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-522404271',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-a24wnjxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:55:08Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=0d2398d7-3b4a-4543-a606-06efd18f41ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31dd19df-5a77-4cc1-973b-dc7602515196", "address": "fa:16:3e:ea:18:93", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31dd19df-5a", "ovs_interfaceid": "31dd19df-5a77-4cc1-973b-dc7602515196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "31dd19df-5a77-4cc1-973b-dc7602515196", "address": "fa:16:3e:ea:18:93", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31dd19df-5a", "ovs_interfaceid": "31dd19df-5a77-4cc1-973b-dc7602515196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:93,bridge_name='br-int',has_traffic_filtering=True,id=31dd19df-5a77-4cc1-973b-dc7602515196,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31dd19df-5a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.objects.instance [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d2398d7-3b4a-4543-a606-06efd18f41ca {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:55:22 user nova-compute[70914]:   <uuid>0d2398d7-3b4a-4543-a606-06efd18f41ca</uuid>
Jul 27 13:55:22 user nova-compute[70914]:   <name>instance-00000027</name>
Jul 27 13:55:22 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:55:22 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:55:22 user nova-compute[70914]:   <metadata>
Jul 27 13:55:22 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:55:22 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:55:22 user nova-compute[70914]:       <nova:name>tempest-TestVolumeBootPattern-server-522404271</nova:name>
Jul 27 13:55:22 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:55:20</nova:creationTime>
Jul 27 13:55:22 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:55:22 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:55:22 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:55:22 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:55:22 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:55:22 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:55:22 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:55:22 user nova-compute[70914]:       <nova:owner>
Jul 27 13:55:22 user nova-compute[70914]:         <nova:user uuid="b6161b1cf5fb4d08a8cbd36a93b8400c">tempest-TestVolumeBootPattern-1923193575-project-member</nova:user>
Jul 27 13:55:22 user nova-compute[70914]:         <nova:project uuid="c73ac071233d44fbb62e558725f63ef8">tempest-TestVolumeBootPattern-1923193575</nova:project>
Jul 27 13:55:22 user nova-compute[70914]:       </nova:owner>
Jul 27 13:55:22 user nova-compute[70914]:       <nova:ports>
Jul 27 13:55:22 user nova-compute[70914]:         <nova:port uuid="31dd19df-5a77-4cc1-973b-dc7602515196">
Jul 27 13:55:22 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 13:55:22 user nova-compute[70914]:         </nova:port>
Jul 27 13:55:22 user nova-compute[70914]:       </nova:ports>
Jul 27 13:55:22 user nova-compute[70914]:     </nova:instance>
Jul 27 13:55:22 user nova-compute[70914]:   </metadata>
Jul 27 13:55:22 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:55:22 user nova-compute[70914]:     <system>
Jul 27 13:55:22 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:55:22 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:55:22 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:55:22 user nova-compute[70914]:       <entry name="serial">0d2398d7-3b4a-4543-a606-06efd18f41ca</entry>
Jul 27 13:55:22 user nova-compute[70914]:       <entry name="uuid">0d2398d7-3b4a-4543-a606-06efd18f41ca</entry>
Jul 27 13:55:22 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:55:22 user nova-compute[70914]:     </system>
Jul 27 13:55:22 user nova-compute[70914]:   </sysinfo>
Jul 27 13:55:22 user nova-compute[70914]:   <os>
Jul 27 13:55:22 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:55:22 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:55:22 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:55:22 user nova-compute[70914]:   </os>
Jul 27 13:55:22 user nova-compute[70914]:   <features>
Jul 27 13:55:22 user nova-compute[70914]:     <acpi/>
Jul 27 13:55:22 user nova-compute[70914]:     <apic/>
Jul 27 13:55:22 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:55:22 user nova-compute[70914]:   </features>
Jul 27 13:55:22 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:55:22 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:55:22 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:55:22 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:55:22 user nova-compute[70914]:   </clock>
Jul 27 13:55:22 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:55:22 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:55:22 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:55:22 user nova-compute[70914]:   </cpu>
Jul 27 13:55:22 user nova-compute[70914]:   <devices>
Jul 27 13:55:22 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:55:22 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:55:22 user nova-compute[70914]:       <source dev="/dev/sdd"/>
Jul 27 13:55:22 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:55:22 user nova-compute[70914]:       <serial>a9b7fe3f-9c62-4d28-a1ca-0070899d8382</serial>
Jul 27 13:55:22 user nova-compute[70914]:     </disk>
Jul 27 13:55:22 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:55:22 user nova-compute[70914]:       <mac address="fa:16:3e:ea:18:93"/>
Jul 27 13:55:22 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:55:22 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:55:22 user nova-compute[70914]:       <target dev="tap31dd19df-5a"/>
Jul 27 13:55:22 user nova-compute[70914]:     </interface>
Jul 27 13:55:22 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:55:22 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/0d2398d7-3b4a-4543-a606-06efd18f41ca/console.log" append="off"/>
Jul 27 13:55:22 user nova-compute[70914]:     </serial>
Jul 27 13:55:22 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:55:22 user nova-compute[70914]:     <video>
Jul 27 13:55:22 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:55:22 user nova-compute[70914]:     </video>
Jul 27 13:55:22 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:55:22 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:55:22 user nova-compute[70914]:     </rng>
Jul 27 13:55:22 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:55:22 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:55:22 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:55:22 user nova-compute[70914]:     </memballoon>
Jul 27 13:55:22 user nova-compute[70914]:   </devices>
Jul 27 13:55:22 user nova-compute[70914]: </domain>
Jul 27 13:55:22 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-522404271',display_name='tempest-TestVolumeBootPattern-server-522404271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-522404271',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-a24wnjxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:55:08Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=0d2398d7-3b4a-4543-a606-06efd18f41ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31dd19df-5a77-4cc1-973b-dc7602515196", "address": "fa:16:3e:ea:18:93", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31dd19df-5a", "ovs_interfaceid": "31dd19df-5a77-4cc1-973b-dc7602515196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "31dd19df-5a77-4cc1-973b-dc7602515196", "address": "fa:16:3e:ea:18:93", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31dd19df-5a", "ovs_interfaceid": "31dd19df-5a77-4cc1-973b-dc7602515196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:93,bridge_name='br-int',has_traffic_filtering=True,id=31dd19df-5a77-4cc1-973b-dc7602515196,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31dd19df-5a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG os_vif [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:93,bridge_name='br-int',has_traffic_filtering=True,id=31dd19df-5a77-4cc1-973b-dc7602515196,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31dd19df-5a') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31dd19df-5a, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31dd19df-5a, col_values=(('external_ids', {'iface-id': '31dd19df-5a77-4cc1-973b-dc7602515196', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:18:93', 'vm-uuid': '0d2398d7-3b4a-4543-a606-06efd18f41ca'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:22 user nova-compute[70914]: INFO os_vif [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:93,bridge_name='br-int',has_traffic_filtering=True,id=31dd19df-5a77-4cc1-973b-dc7602515196,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31dd19df-5a')
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:55:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No VIF found with MAC fa:16:3e:ea:18:93, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:55:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-9afaf711-6aae-4cb1-a0c3-aa6b28c2355a req-b471c59a-f420-4d2c-85d7-732e266694e0 service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Received event network-vif-plugged-31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:55:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9afaf711-6aae-4cb1-a0c3-aa6b28c2355a req-b471c59a-f420-4d2c-85d7-732e266694e0 service nova] Acquiring lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9afaf711-6aae-4cb1-a0c3-aa6b28c2355a req-b471c59a-f420-4d2c-85d7-732e266694e0 service nova] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9afaf711-6aae-4cb1-a0c3-aa6b28c2355a req-b471c59a-f420-4d2c-85d7-732e266694e0 service nova] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-9afaf711-6aae-4cb1-a0c3-aa6b28c2355a req-b471c59a-f420-4d2c-85d7-732e266694e0 service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] No waiting events found dispatching network-vif-plugged-31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:55:23 user nova-compute[70914]: WARNING nova.compute.manager [req-9afaf711-6aae-4cb1-a0c3-aa6b28c2355a req-b471c59a-f420-4d2c-85d7-732e266694e0 service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Received unexpected event network-vif-plugged-31dd19df-5a77-4cc1-973b-dc7602515196 for instance with vm_state building and task_state spawning.
Jul 27 13:55:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466125.6034389, 0d2398d7-3b4a-4543-a606-06efd18f41ca => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:55:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] VM Resumed (Lifecycle Event)
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:55:25 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Instance spawned successfully.
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:55:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466125.607547, 0d2398d7-3b4a-4543-a606-06efd18f41ca => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:55:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] VM Started (Lifecycle Event)
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:55:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:55:25 user nova-compute[70914]: INFO nova.compute.manager [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Took 4.95 seconds to spawn the instance on the hypervisor.
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-eea10ae5-6f78-4a2d-9ff1-865cc8c30d8b req-f51aa9c5-41b3-4147-9ead-665002d35548 service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Received event network-vif-plugged-31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-eea10ae5-6f78-4a2d-9ff1-865cc8c30d8b req-f51aa9c5-41b3-4147-9ead-665002d35548 service nova] Acquiring lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-eea10ae5-6f78-4a2d-9ff1-865cc8c30d8b req-f51aa9c5-41b3-4147-9ead-665002d35548 service nova] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-eea10ae5-6f78-4a2d-9ff1-865cc8c30d8b req-f51aa9c5-41b3-4147-9ead-665002d35548 service nova] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-eea10ae5-6f78-4a2d-9ff1-865cc8c30d8b req-f51aa9c5-41b3-4147-9ead-665002d35548 service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] No waiting events found dispatching network-vif-plugged-31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:55:25 user nova-compute[70914]: WARNING nova.compute.manager [req-eea10ae5-6f78-4a2d-9ff1-865cc8c30d8b req-f51aa9c5-41b3-4147-9ead-665002d35548 service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Received unexpected event network-vif-plugged-31dd19df-5a77-4cc1-973b-dc7602515196 for instance with vm_state building and task_state spawning.
Jul 27 13:55:25 user nova-compute[70914]: INFO nova.compute.manager [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Took 18.33 seconds to build instance.
Jul 27 13:55:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-373324c3-9d91-459f-af0b-e5b8db2c637e tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.417s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:28 user nova-compute[70914]: INFO nova.compute.manager [None req-f53efc74-5afb-40f0-932f-d0828b3ee4e4 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Unrescuing
Jul 27 13:55:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f53efc74-5afb-40f0-932f-d0828b3ee4e4 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:55:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f53efc74-5afb-40f0-932f-d0828b3ee4e4 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquired lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:55:28 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f53efc74-5afb-40f0-932f-d0828b3ee4e4 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG nova.network.neutron [None req-f53efc74-5afb-40f0-932f-d0828b3ee4e4 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Updating instance_info_cache with network_info: [{"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-f53efc74-5afb-40f0-932f-d0828b3ee4e4 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Releasing lock "refresh_cache-fc2a646b-4612-44e3-b2c2-6c53fc65eef1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG nova.objects.instance [None req-f53efc74-5afb-40f0-932f-d0828b3ee4e4 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'flavor' on Instance uuid fc2a646b-4612-44e3-b2c2-6c53fc65eef1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-547cce87-dbcb-4698-92f1-e3e370d20a37 req-44906356-49ce-47db-8fdc-aef0e58f9cb3 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-unplugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-547cce87-dbcb-4698-92f1-e3e370d20a37 req-44906356-49ce-47db-8fdc-aef0e58f9cb3 service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-547cce87-dbcb-4698-92f1-e3e370d20a37 req-44906356-49ce-47db-8fdc-aef0e58f9cb3 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-547cce87-dbcb-4698-92f1-e3e370d20a37 req-44906356-49ce-47db-8fdc-aef0e58f9cb3 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG nova.compute.manager [req-547cce87-dbcb-4698-92f1-e3e370d20a37 req-44906356-49ce-47db-8fdc-aef0e58f9cb3 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-unplugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:55:29 user nova-compute[70914]: WARNING nova.compute.manager [req-547cce87-dbcb-4698-92f1-e3e370d20a37 req-44906356-49ce-47db-8fdc-aef0e58f9cb3 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-unplugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:55:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:29 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Instance destroyed successfully.
Jul 27 13:55:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:55:31 user nova-compute[70914]: WARNING nova.compute.manager [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:55:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:55:31 user nova-compute[70914]: WARNING nova.compute.manager [req-c651b919-3bcf-4eef-80ad-87035ccb2ee7 req-1ec1fd5f-716e-40db-b67c-f695bc083eaa service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state rescued and task_state unrescuing.
Jul 27 13:55:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:33 user nova-compute[70914]: INFO nova.compute.manager [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Terminating instance
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Removed pending event for fc2a646b-4612-44e3-b2c2-6c53fc65eef1 due to event {{(pid=70914) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466133.3581345, fc2a646b-4612-44e3-b2c2-6c53fc65eef1 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:55:33 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] VM Resumed (Lifecycle Event)
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f53efc74-5afb-40f0-932f-d0828b3ee4e4 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:33 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466133.3583045, fc2a646b-4612-44e3-b2c2-6c53fc65eef1 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:55:33 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] VM Started (Lifecycle Event)
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-339460b5-7faf-418a-923c-7a21b3b55add req-85cfded1-a63f-40e5-a562-c595545cd55f service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-339460b5-7faf-418a-923c-7a21b3b55add req-85cfded1-a63f-40e5-a562-c595545cd55f service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-339460b5-7faf-418a-923c-7a21b3b55add req-85cfded1-a63f-40e5-a562-c595545cd55f service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-339460b5-7faf-418a-923c-7a21b3b55add req-85cfded1-a63f-40e5-a562-c595545cd55f service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-339460b5-7faf-418a-923c-7a21b3b55add req-85cfded1-a63f-40e5-a562-c595545cd55f service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:55:33 user nova-compute[70914]: WARNING nova.compute.manager [req-339460b5-7faf-418a-923c-7a21b3b55add req-85cfded1-a63f-40e5-a562-c595545cd55f service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state active and task_state None.
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-7d6f088b-13f2-4899-b706-7ac7504c42cf req-2513a1cd-e830-4bf1-9d2d-4e2aed9c20ad service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-vif-unplugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7d6f088b-13f2-4899-b706-7ac7504c42cf req-2513a1cd-e830-4bf1-9d2d-4e2aed9c20ad service nova] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7d6f088b-13f2-4899-b706-7ac7504c42cf req-2513a1cd-e830-4bf1-9d2d-4e2aed9c20ad service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7d6f088b-13f2-4899-b706-7ac7504c42cf req-2513a1cd-e830-4bf1-9d2d-4e2aed9c20ad service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-7d6f088b-13f2-4899-b706-7ac7504c42cf req-2513a1cd-e830-4bf1-9d2d-4e2aed9c20ad service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] No waiting events found dispatching network-vif-unplugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:55:33 user nova-compute[70914]: DEBUG nova.compute.manager [req-7d6f088b-13f2-4899-b706-7ac7504c42cf req-2513a1cd-e830-4bf1-9d2d-4e2aed9c20ad service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-vif-unplugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:55:34 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Instance destroyed successfully.
Jul 27 13:55:34 user nova-compute[70914]: DEBUG nova.objects.instance [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lazy-loading 'resources' on Instance uuid 8377b22e-d359-47c3-bd2d-8b008b35a042 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1517703466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1517703466',id=35,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQsx1ABdF1oDTTHl2dQ73XB30MjY84hupfzPAlDU7Hq+iafUfMvhxLO4Yt6zdhIuLdfyifLOZP35dbq9sYWgYcm/G9+mETkYtsf6WOEE/p8U3nu5Q7skPw4zfL5zH2xlA==',key_name='tempest-keypair-1401762589',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30c132beeb2d43b1b568da4492f2ffc9',ramdisk_id='',reservation_id='r-8k9aidcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90363656',owner_user_name='tempest-AttachVolumeShelveTestJSON-90363656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce42c397b5d44afd9c12497b2bf40fb5',uuid=8377b22e-d359-47c3-bd2d-8b008b35a042,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converting VIF {"id": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "address": "fa:16:3e:f9:cf:c1", "network": {"id": "8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-982770480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c132beeb2d43b1b568da4492f2ffc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce0387e-c2", "ovs_interfaceid": "6ce0387e-c296-41be-b5e6-9d5ab538cec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG os_vif [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ce0387e-c2, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:55:34 user nova-compute[70914]: INFO os_vif [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cf:c1,bridge_name='br-int',has_traffic_filtering=True,id=6ce0387e-c296-41be-b5e6-9d5ab538cec8,network=Network(8bb8e0b2-0e51-46ae-ae94-4e6392cdf28a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce0387e-c2')
Jul 27 13:55:34 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Deleting instance files /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042_del
Jul 27 13:55:34 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Deletion of /opt/stack/data/nova/instances/8377b22e-d359-47c3-bd2d-8b008b35a042_del complete
Jul 27 13:55:34 user nova-compute[70914]: INFO nova.compute.manager [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 27 13:55:34 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:55:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-5016b999-2c7b-47a4-b906-026b80104d3a req-ca48edc3-32f2-4d96-a557-f17b84d36d56 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:55:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5016b999-2c7b-47a4-b906-026b80104d3a req-ca48edc3-32f2-4d96-a557-f17b84d36d56 service nova] Acquiring lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5016b999-2c7b-47a4-b906-026b80104d3a req-ca48edc3-32f2-4d96-a557-f17b84d36d56 service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5016b999-2c7b-47a4-b906-026b80104d3a req-ca48edc3-32f2-4d96-a557-f17b84d36d56 service nova] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-5016b999-2c7b-47a4-b906-026b80104d3a req-ca48edc3-32f2-4d96-a557-f17b84d36d56 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] No waiting events found dispatching network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:55:35 user nova-compute[70914]: WARNING nova.compute.manager [req-5016b999-2c7b-47a4-b906-026b80104d3a req-ca48edc3-32f2-4d96-a557-f17b84d36d56 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received unexpected event network-vif-plugged-6ce0387e-c296-41be-b5e6-9d5ab538cec8 for instance with vm_state active and task_state deleting.
Jul 27 13:55:35 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:55:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-22502554-1f2b-4562-8604-687e896720a0 req-67da79b9-950e-4ea4-ae28-6c1681d9a181 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Received event network-vif-deleted-6ce0387e-c296-41be-b5e6-9d5ab538cec8 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:55:35 user nova-compute[70914]: INFO nova.compute.manager [req-22502554-1f2b-4562-8604-687e896720a0 req-67da79b9-950e-4ea4-ae28-6c1681d9a181 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Neutron deleted interface 6ce0387e-c296-41be-b5e6-9d5ab538cec8; detaching it from the instance and deleting it from the info cache
Jul 27 13:55:35 user nova-compute[70914]: DEBUG nova.network.neutron [req-22502554-1f2b-4562-8604-687e896720a0 req-67da79b9-950e-4ea4-ae28-6c1681d9a181 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:55:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-22502554-1f2b-4562-8604-687e896720a0 req-67da79b9-950e-4ea4-ae28-6c1681d9a181 service nova] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Detach interface failed, port_id=6ce0387e-c296-41be-b5e6-9d5ab538cec8, reason: Instance 8377b22e-d359-47c3-bd2d-8b008b35a042 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:55:35 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Took 1.48 seconds to deallocate network for instance.
Jul 27 13:55:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:35 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:55:36 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:55:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:36 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Deleted allocations for instance 8377b22e-d359-47c3-bd2d-8b008b35a042
Jul 27 13:55:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fe265894-1ad7-4cae-9f08-5fbfb7c19d25 tempest-AttachVolumeShelveTestJSON-90363656 tempest-AttachVolumeShelveTestJSON-90363656-project-member] Lock "8377b22e-d359-47c3-bd2d-8b008b35a042" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.894s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:55:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:55:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:55:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:55:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:49 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466134.0871058, 8377b22e-d359-47c3-bd2d-8b008b35a042 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:55:49 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] VM Stopped (Lifecycle Event)
Jul 27 13:55:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-133003df-118a-4a3d-8127-6b8cf03f145c None None] [instance: 8377b22e-d359-47c3-bd2d-8b008b35a042] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:55:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:55:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:55:55 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:55:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:55:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:55:55 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:55:56 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:55:56 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=7930MB free_disk=25.136581420898438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cd4b9913-ab18-42d7-abd7-c4dad48375c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance fc2a646b-4612-44e3-b2c2-6c53fc65eef1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e595326a-2178-48d1-ba18-a703a76c23b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance b5734110-eb9c-4ba8-af64-351e5c8b59ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0d2398d7-3b4a-4543-a606-06efd18f41ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:55:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:55:57 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:55:57 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:55:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:55:57 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:55:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:55:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:55:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:56:00 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:56:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:56:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 13:56:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:56:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-45fd0071-ee7e-43e0-af66-7b5b615971cb req-8f9fff6a-8691-4dcb-810a-9276d3dce711 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-changed-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:56:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-45fd0071-ee7e-43e0-af66-7b5b615971cb req-8f9fff6a-8691-4dcb-810a-9276d3dce711 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Refreshing instance network info cache due to event network-changed-1a00fbed-0a5c-49d1-800a-238f198d6411. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:56:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-45fd0071-ee7e-43e0-af66-7b5b615971cb req-8f9fff6a-8691-4dcb-810a-9276d3dce711 service nova] Acquiring lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:56:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-45fd0071-ee7e-43e0-af66-7b5b615971cb req-8f9fff6a-8691-4dcb-810a-9276d3dce711 service nova] Acquired lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:56:14 user nova-compute[70914]: DEBUG nova.network.neutron [req-45fd0071-ee7e-43e0-af66-7b5b615971cb req-8f9fff6a-8691-4dcb-810a-9276d3dce711 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Refreshing network info cache for port 1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:56:15 user nova-compute[70914]: DEBUG nova.network.neutron [req-45fd0071-ee7e-43e0-af66-7b5b615971cb req-8f9fff6a-8691-4dcb-810a-9276d3dce711 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updated VIF entry in instance network info cache for port 1a00fbed-0a5c-49d1-800a-238f198d6411. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:56:15 user nova-compute[70914]: DEBUG nova.network.neutron [req-45fd0071-ee7e-43e0-af66-7b5b615971cb req-8f9fff6a-8691-4dcb-810a-9276d3dce711 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating instance_info_cache with network_info: [{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:56:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-45fd0071-ee7e-43e0-af66-7b5b615971cb req-8f9fff6a-8691-4dcb-810a-9276d3dce711 service nova] Releasing lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:56:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "e595326a-2178-48d1-ba18-a703a76c23b9" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:16 user nova-compute[70914]: INFO nova.compute.manager [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Shelve offloading
Jul 27 13:56:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:16 user nova-compute[70914]: DEBUG nova.compute.manager [req-4d041994-ca05-4859-bf73-9699d35260bd req-8ea9cd5d-e7ef-4b1e-ae70-0c25862f766b service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-vif-unplugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:56:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4d041994-ca05-4859-bf73-9699d35260bd req-8ea9cd5d-e7ef-4b1e-ae70-0c25862f766b service nova] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4d041994-ca05-4859-bf73-9699d35260bd req-8ea9cd5d-e7ef-4b1e-ae70-0c25862f766b service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4d041994-ca05-4859-bf73-9699d35260bd req-8ea9cd5d-e7ef-4b1e-ae70-0c25862f766b service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:16 user nova-compute[70914]: DEBUG nova.compute.manager [req-4d041994-ca05-4859-bf73-9699d35260bd req-8ea9cd5d-e7ef-4b1e-ae70-0c25862f766b service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] No waiting events found dispatching network-vif-unplugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:56:16 user nova-compute[70914]: WARNING nova.compute.manager [req-4d041994-ca05-4859-bf73-9699d35260bd req-8ea9cd5d-e7ef-4b1e-ae70-0c25862f766b service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received unexpected event network-vif-unplugged-1a00fbed-0a5c-49d1-800a-238f198d6411 for instance with vm_state active and task_state shelving.
Jul 27 13:56:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Instance destroyed successfully.
Jul 27 13:56:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:56:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:56:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquired lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:56:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:56:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating instance_info_cache with network_info: [{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:56:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Releasing lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:56:18 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Instance destroyed successfully.
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.objects.instance [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lazy-loading 'resources' on Instance uuid e595326a-2178-48d1-ba18-a703a76c23b9 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-258381433',display_name='tempest-TestShelveInstance-server-258381433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-258381433',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWePivK+ohgjpS7ULQzMfaCzLUyr/7CHWKxilUPtHxYrRlp72yp93hD1Z5eSxIa4WP8mEJqldom5IIAc+OdNMzBZHqjbe9xt5xD6TsxEiBwtF+4H4rTwdUm8eS/uyZT/g==',key_name='tempest-TestShelveInstance-597209222',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fc9d12d3f5942cc978d1b3636c29335',ramdisk_id='',reservation_id='r-g9ugvfau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1359726663',owner_user_name='tempest-TestShelveInstance-1359726663-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:54:36Z,user_data=None,user_id='bc9d168610c040b9b7931474e241c3f6',uuid=e595326a-2178-48d1-ba18-a703a76c23b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converting VIF {"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_vif [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a00fbed-0a, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:56:18 user nova-compute[70914]: INFO os_vif [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a')
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxOPtmKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:56:18 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3561dd-df15-47fd-9918-9646a3419c77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:56:18 user nova-compute[70914]: No targets found.
Jul 27 13:56:18 user nova-compute[70914]: iSNS:
Jul 27 13:56:18 user nova-compute[70914]: No targets found.
Jul 27 13:56:18 user nova-compute[70914]: STATIC:
Jul 27 13:56:18 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382
Jul 27 13:56:18 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:56:18 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:56:18 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:56:18 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:56:18 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:56:18 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0
Jul 27 13:56:18 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:56:18 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:56:18 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac
Jul 27 13:56:18 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:56:18 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:56:18 user nova-compute[70914]: FIRMWARE:
Jul 27 13:56:18 user nova-compute[70914]: No targets found.
Jul 27 13:56:18 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:56:18 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:56:18 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3076d6-bc28-4432-bed2-713126877c61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd77fcd1-3aa3-4a9f-9dd9-dd0abe72ac8c]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:56:18 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:56:18 user nova-compute[70914]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:56:18 user nova-compute[70914]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)
Jul 27 13:56:18 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:56:18 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:56:18 user nova-compute[70914]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:56:18 user nova-compute[70914]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)
Jul 27 13:56:18 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c47549480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c6b1ff-8c36-496d-9d19-76064afbe787]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[68117381-bf7a-4aca-9d9b-9de835eeccb2]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc6d1f3-7ec7-4f25-9212-eb315bff0d67]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5bc450-5ba9-4812-946c-718da0b57797]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5504ce93-23e7-425f-b0b4-41093bb33465]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c98ebd8-82b8-4282-b31e-7fac0067a857]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260]
Jul 27 13:56:18 user nova-compute[70914]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260] successful.
Jul 27 13:56:18 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[503511cf-a51e-42a3-8986-bbc364694564]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] <== disconnect_volume: return (317ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:56:18 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Deleting instance files /opt/stack/data/nova/instances/e595326a-2178-48d1-ba18-a703a76c23b9_del
Jul 27 13:56:18 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Deletion of /opt/stack/data/nova/instances/e595326a-2178-48d1-ba18-a703a76c23b9_del complete
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] No waiting events found dispatching network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:56:18 user nova-compute[70914]: WARNING nova.compute.manager [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received unexpected event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 for instance with vm_state active and task_state shelving.
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-changed-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Refreshing instance network info cache due to event network-changed-1a00fbed-0a5c-49d1-800a-238f198d6411. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] Acquiring lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] Acquired lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:56:18 user nova-compute[70914]: DEBUG nova.network.neutron [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Refreshing network info cache for port 1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:56:19 user nova-compute[70914]: DEBUG nova.network.neutron [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updated VIF entry in instance network info cache for port 1a00fbed-0a5c-49d1-800a-238f198d6411. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:56:19 user nova-compute[70914]: DEBUG nova.network.neutron [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating instance_info_cache with network_info: [{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": null, "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:56:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa426aab-fdf9-4950-a873-844fc0087797 req-0e212d0a-e535-446c-9dea-909e143ba6b2 service nova] Releasing lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:56:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:19 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Deleted allocations for instance e595326a-2178-48d1-ba18-a703a76c23b9
Jul 27 13:56:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:19 user nova-compute[70914]: DEBUG nova.objects.instance [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lazy-loading 'numa_topology' on Instance uuid e595326a-2178-48d1-ba18-a703a76c23b9 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:56:20 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:56:20 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:56:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-b0dc5785-b723-4a11-b94a-c9e66445aff7 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "e595326a-2178-48d1-ba18-a703a76c23b9" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.684s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-40a2f796-d9bf-42bb-bd52-f9b421b62de3 req-5dc454f8-6612-4a03-84fd-1346f460292b service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received event network-changed-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:56:31 user nova-compute[70914]: DEBUG nova.compute.manager [req-40a2f796-d9bf-42bb-bd52-f9b421b62de3 req-5dc454f8-6612-4a03-84fd-1346f460292b service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Refreshing instance network info cache due to event network-changed-509f9e28-206a-4400-9e8f-a5895875961b. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:56:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-40a2f796-d9bf-42bb-bd52-f9b421b62de3 req-5dc454f8-6612-4a03-84fd-1346f460292b service nova] Acquiring lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:56:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-40a2f796-d9bf-42bb-bd52-f9b421b62de3 req-5dc454f8-6612-4a03-84fd-1346f460292b service nova] Acquired lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:56:31 user nova-compute[70914]: DEBUG nova.network.neutron [req-40a2f796-d9bf-42bb-bd52-f9b421b62de3 req-5dc454f8-6612-4a03-84fd-1346f460292b service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Refreshing network info cache for port 509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:56:32 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466177.2456682, e595326a-2178-48d1-ba18-a703a76c23b9 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:56:32 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] VM Stopped (Lifecycle Event)
Jul 27 13:56:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f562a5fb-caf9-452c-a52b-f0fa76e54222 None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:56:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-40a2f796-d9bf-42bb-bd52-f9b421b62de3 req-5dc454f8-6612-4a03-84fd-1346f460292b service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Updated VIF entry in instance network info cache for port 509f9e28-206a-4400-9e8f-a5895875961b. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:56:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-40a2f796-d9bf-42bb-bd52-f9b421b62de3 req-5dc454f8-6612-4a03-84fd-1346f460292b service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Updating instance_info_cache with network_info: [{"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:56:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-40a2f796-d9bf-42bb-bd52-f9b421b62de3 req-5dc454f8-6612-4a03-84fd-1346f460292b service nova] Releasing lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:56:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:56:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:56:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:56:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:56:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:35 user nova-compute[70914]: DEBUG nova.objects.instance [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'flavor' on Instance uuid b5734110-eb9c-4ba8-af64-351e5c8b59ef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:56:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:35 user nova-compute[70914]: INFO nova.compute.manager [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Attaching volume f7727af1-e3ca-42c1-a372-1ea9cd5eccfd to /dev/vdb
Jul 27 13:56:36 user nova-compute[70914]: DEBUG os_brick.utils [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fba592d-5dcb-40de-9f2b-a7b6f2cc78dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[295e3bba-96bb-4ebf-be71-37ba1b2ccedd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dba8268-8113-4042-a2c7-e0cce7235809]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0021f8-eec0-4cbf-9f00-9b2b36b031ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:56:36 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:56:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47ffa44-1cc0-4997-b8be-49890d32aa65]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG os_brick.utils [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:56:36 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Updating existing volume attachment record: 57b180a4-9ea5-466f-8b1f-a2e219703e59 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:56:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqemuQpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:56:43 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:56:43 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:56:43 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae3c869-6755-40c5-91bb-419eaed1522d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:56:43 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac77476f-982a-4947-b7ef-c32862a50a24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd] added
Jul 27 13:56:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1681861-a69b-4d3e-aac1-d467ae7a203c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[07991486-8b03-47e7-b03f-609ee959eaa5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xqemuQpM {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xqemuQpM" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee82a00b-8a4b-4017-8051-84f6cbae0a45]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xqemuQpM'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f44d18-0113-46b9-8aa3-ed3876a64ca8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[17776b1e-18ce-4572-81ad-6170e234ae4a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:56:43 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:56:43 user nova-compute[70914]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)
Jul 27 13:56:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:56:43 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:56:43 user nova-compute[70914]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)
Jul 27 13:56:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f6c9a5-6f9e-456d-b88b-590d90bab475]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd, portal: 172.16.0.220,3260]
Jul 27 13:56:43 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd, portal: 172.16.0.220,3260] successful.
Jul 27 13:56:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[771b798f-8fd2-4979-b8cd-c80e450e4dc2]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[341e8192-534b-4ebd-883f-9e5f006b91dc]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:56:43 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:56:43 user nova-compute[70914]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)
Jul 27 13:56:43 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:56:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:56:43 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:56:43 user nova-compute[70914]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)
Jul 27 13:56:43 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:56:43 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5423e3-5379-4051-b325-69120d43d812]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:56:43 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqemuQpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:56:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:56:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23066646538623562', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:56:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066646538623562', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:56:44 user nova-compute[70914]: DEBUG nova.objects.instance [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'flavor' on Instance uuid b5734110-eb9c-4ba8-af64-351e5c8b59ef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:56:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 13:56:44 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:56:44 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:56:44 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:56:44 user nova-compute[70914]:   <serial>f7727af1-e3ca-42c1-a372-1ea9cd5eccfd</serial>
Jul 27 13:56:44 user nova-compute[70914]: </disk>
Jul 27 13:56:44 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 13:56:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:56:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:56:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No VIF found with MAC fa:16:3e:5a:de:65, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:56:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-000f8132-e5c9-4246-b2bd-5acf05434c20 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.480s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "39ea2b19-a667-4f90-91a9-c692d6f544fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:48 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:56:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:48 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:56:48 user nova-compute[70914]: INFO nova.compute.claims [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Claim successful on node user
Jul 27 13:56:48 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:56:49 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.policy [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39c9278ea5d24d2a9182c20bcb32febb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8032e7912884d3bb9a66632f95137ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:56:49 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Creating image(s)
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "/opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "/opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "/opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.132s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.131s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk 1073741824" returned: 0 in 0.056s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Cannot resize image /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'migration_context' on Instance uuid 39ea2b19-a667-4f90-91a9-c692d6f544fb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Ensure instance console log exists: /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:49 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Successfully created port: 4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:56:50 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Successfully updated port: 4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:56:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "refresh_cache-39ea2b19-a667-4f90-91a9-c692d6f544fb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:56:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquired lock "refresh_cache-39ea2b19-a667-4f90-91a9-c692d6f544fb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:56:50 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:56:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-e069c736-9c38-428b-badb-a9749d314346 req-fe0d291c-23c8-4d73-8a86-1823c2efe0fa service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received event network-changed-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:56:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-e069c736-9c38-428b-badb-a9749d314346 req-fe0d291c-23c8-4d73-8a86-1823c2efe0fa service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Refreshing instance network info cache due to event network-changed-4d277236-9aa3-44e5-8cd8-7b50e12bd663. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:56:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e069c736-9c38-428b-badb-a9749d314346 req-fe0d291c-23c8-4d73-8a86-1823c2efe0fa service nova] Acquiring lock "refresh_cache-39ea2b19-a667-4f90-91a9-c692d6f544fb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:56:50 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.network.neutron [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Updating instance_info_cache with network_info: [{"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Releasing lock "refresh_cache-39ea2b19-a667-4f90-91a9-c692d6f544fb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Instance network_info: |[{"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e069c736-9c38-428b-badb-a9749d314346 req-fe0d291c-23c8-4d73-8a86-1823c2efe0fa service nova] Acquired lock "refresh_cache-39ea2b19-a667-4f90-91a9-c692d6f544fb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-e069c736-9c38-428b-badb-a9749d314346 req-fe0d291c-23c8-4d73-8a86-1823c2efe0fa service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Refreshing network info cache for port 4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Start _get_guest_xml network_info=[{"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:56:51 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:56:51 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-470809687',display_name='tempest-AttachVolumeNegativeTest-server-470809687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-470809687',id=40,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4q2Td3MXSeV4ultWdQjqC9PQNBdZmgFZLZP66H4N9nwGsm7Tp5honoYfGO6oabtlbhQKVXwSWMzR15cx9OQ12Fr/0svjN1hTLJMjhN+t4TLK4jhBvrYwMLWeZJaK9hog==',key_name='tempest-keypair-1748918594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-ej9ut66y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=39ea2b19-a667-4f90-91a9-c692d6f544fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7c:3e,bridge_name='br-int',has_traffic_filtering=True,id=4d277236-9aa3-44e5-8cd8-7b50e12bd663,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d277236-9a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'pci_devices' on Instance uuid 39ea2b19-a667-4f90-91a9-c692d6f544fb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:56:51 user nova-compute[70914]:   <uuid>39ea2b19-a667-4f90-91a9-c692d6f544fb</uuid>
Jul 27 13:56:51 user nova-compute[70914]:   <name>instance-00000028</name>
Jul 27 13:56:51 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:56:51 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:56:51 user nova-compute[70914]:   <metadata>
Jul 27 13:56:51 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:56:51 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:56:51 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeNegativeTest-server-470809687</nova:name>
Jul 27 13:56:51 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:56:51</nova:creationTime>
Jul 27 13:56:51 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:56:51 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:56:51 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:56:51 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:56:51 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:56:51 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:56:51 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:56:51 user nova-compute[70914]:       <nova:owner>
Jul 27 13:56:51 user nova-compute[70914]:         <nova:user uuid="39c9278ea5d24d2a9182c20bcb32febb">tempest-AttachVolumeNegativeTest-431364948-project-member</nova:user>
Jul 27 13:56:51 user nova-compute[70914]:         <nova:project uuid="f8032e7912884d3bb9a66632f95137ad">tempest-AttachVolumeNegativeTest-431364948</nova:project>
Jul 27 13:56:51 user nova-compute[70914]:       </nova:owner>
Jul 27 13:56:51 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:56:51 user nova-compute[70914]:       <nova:ports>
Jul 27 13:56:51 user nova-compute[70914]:         <nova:port uuid="4d277236-9aa3-44e5-8cd8-7b50e12bd663">
Jul 27 13:56:51 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 13:56:51 user nova-compute[70914]:         </nova:port>
Jul 27 13:56:51 user nova-compute[70914]:       </nova:ports>
Jul 27 13:56:51 user nova-compute[70914]:     </nova:instance>
Jul 27 13:56:51 user nova-compute[70914]:   </metadata>
Jul 27 13:56:51 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:56:51 user nova-compute[70914]:     <system>
Jul 27 13:56:51 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:56:51 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:56:51 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:56:51 user nova-compute[70914]:       <entry name="serial">39ea2b19-a667-4f90-91a9-c692d6f544fb</entry>
Jul 27 13:56:51 user nova-compute[70914]:       <entry name="uuid">39ea2b19-a667-4f90-91a9-c692d6f544fb</entry>
Jul 27 13:56:51 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:56:51 user nova-compute[70914]:     </system>
Jul 27 13:56:51 user nova-compute[70914]:   </sysinfo>
Jul 27 13:56:51 user nova-compute[70914]:   <os>
Jul 27 13:56:51 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:56:51 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:56:51 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:56:51 user nova-compute[70914]:   </os>
Jul 27 13:56:51 user nova-compute[70914]:   <features>
Jul 27 13:56:51 user nova-compute[70914]:     <acpi/>
Jul 27 13:56:51 user nova-compute[70914]:     <apic/>
Jul 27 13:56:51 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:56:51 user nova-compute[70914]:   </features>
Jul 27 13:56:51 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:56:51 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:56:51 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:56:51 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:56:51 user nova-compute[70914]:   </clock>
Jul 27 13:56:51 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:56:51 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:56:51 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:56:51 user nova-compute[70914]:   </cpu>
Jul 27 13:56:51 user nova-compute[70914]:   <devices>
Jul 27 13:56:51 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:56:51 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:56:51 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk"/>
Jul 27 13:56:51 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:56:51 user nova-compute[70914]:     </disk>
Jul 27 13:56:51 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:56:51 user nova-compute[70914]:       <mac address="fa:16:3e:da:7c:3e"/>
Jul 27 13:56:51 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:56:51 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:56:51 user nova-compute[70914]:       <target dev="tap4d277236-9a"/>
Jul 27 13:56:51 user nova-compute[70914]:     </interface>
Jul 27 13:56:51 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:56:51 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/console.log" append="off"/>
Jul 27 13:56:51 user nova-compute[70914]:     </serial>
Jul 27 13:56:51 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:56:51 user nova-compute[70914]:     <video>
Jul 27 13:56:51 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:56:51 user nova-compute[70914]:     </video>
Jul 27 13:56:51 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:56:51 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:56:51 user nova-compute[70914]:     </rng>
Jul 27 13:56:51 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:56:51 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:56:51 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:56:51 user nova-compute[70914]:     </memballoon>
Jul 27 13:56:51 user nova-compute[70914]:   </devices>
Jul 27 13:56:51 user nova-compute[70914]: </domain>
Jul 27 13:56:51 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-470809687',display_name='tempest-AttachVolumeNegativeTest-server-470809687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-470809687',id=40,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4q2Td3MXSeV4ultWdQjqC9PQNBdZmgFZLZP66H4N9nwGsm7Tp5honoYfGO6oabtlbhQKVXwSWMzR15cx9OQ12Fr/0svjN1hTLJMjhN+t4TLK4jhBvrYwMLWeZJaK9hog==',key_name='tempest-keypair-1748918594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-ej9ut66y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=39ea2b19-a667-4f90-91a9-c692d6f544fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7c:3e,bridge_name='br-int',has_traffic_filtering=True,id=4d277236-9aa3-44e5-8cd8-7b50e12bd663,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d277236-9a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG os_vif [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7c:3e,bridge_name='br-int',has_traffic_filtering=True,id=4d277236-9aa3-44e5-8cd8-7b50e12bd663,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d277236-9a') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d277236-9a, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d277236-9a, col_values=(('external_ids', {'iface-id': '4d277236-9aa3-44e5-8cd8-7b50e12bd663', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:7c:3e', 'vm-uuid': '39ea2b19-a667-4f90-91a9-c692d6f544fb'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:51 user nova-compute[70914]: INFO os_vif [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7c:3e,bridge_name='br-int',has_traffic_filtering=True,id=4d277236-9aa3-44e5-8cd8-7b50e12bd663,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d277236-9a')
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No VIF found with MAC fa:16:3e:da:7c:3e, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-e069c736-9c38-428b-badb-a9749d314346 req-fe0d291c-23c8-4d73-8a86-1823c2efe0fa service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Updated VIF entry in instance network info cache for port 4d277236-9aa3-44e5-8cd8-7b50e12bd663. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG nova.network.neutron [req-e069c736-9c38-428b-badb-a9749d314346 req-fe0d291c-23c8-4d73-8a86-1823c2efe0fa service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Updating instance_info_cache with network_info: [{"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:56:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e069c736-9c38-428b-badb-a9749d314346 req-fe0d291c-23c8-4d73-8a86-1823c2efe0fa service nova] Releasing lock "refresh_cache-39ea2b19-a667-4f90-91a9-c692d6f544fb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-97b00274-d697-415f-8ef2-5ba2881612c4 req-44882a62-c25b-419f-8350-552d87d5c227 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received event network-vif-plugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-97b00274-d697-415f-8ef2-5ba2881612c4 req-44882a62-c25b-419f-8350-552d87d5c227 service nova] Acquiring lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-97b00274-d697-415f-8ef2-5ba2881612c4 req-44882a62-c25b-419f-8350-552d87d5c227 service nova] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-97b00274-d697-415f-8ef2-5ba2881612c4 req-44882a62-c25b-419f-8350-552d87d5c227 service nova] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-97b00274-d697-415f-8ef2-5ba2881612c4 req-44882a62-c25b-419f-8350-552d87d5c227 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] No waiting events found dispatching network-vif-plugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:56:52 user nova-compute[70914]: WARNING nova.compute.manager [req-97b00274-d697-415f-8ef2-5ba2881612c4 req-44882a62-c25b-419f-8350-552d87d5c227 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received unexpected event network-vif-plugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 for instance with vm_state building and task_state spawning.
Jul 27 13:56:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466214.6982415, 39ea2b19-a667-4f90-91a9-c692d6f544fb => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:56:54 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] VM Resumed (Lifecycle Event)
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:56:54 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Instance spawned successfully.
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:56:54 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466214.6998186, 39ea2b19-a667-4f90-91a9-c692d6f544fb => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:56:54 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] VM Started (Lifecycle Event)
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:56:54 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-810b3a61-c3f3-4de2-96f6-f8f21f238cf0 req-c9d4acfa-5bba-4a4e-8fa1-753df6982d4d service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received event network-vif-plugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-810b3a61-c3f3-4de2-96f6-f8f21f238cf0 req-c9d4acfa-5bba-4a4e-8fa1-753df6982d4d service nova] Acquiring lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-810b3a61-c3f3-4de2-96f6-f8f21f238cf0 req-c9d4acfa-5bba-4a4e-8fa1-753df6982d4d service nova] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-810b3a61-c3f3-4de2-96f6-f8f21f238cf0 req-c9d4acfa-5bba-4a4e-8fa1-753df6982d4d service nova] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-810b3a61-c3f3-4de2-96f6-f8f21f238cf0 req-c9d4acfa-5bba-4a4e-8fa1-753df6982d4d service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] No waiting events found dispatching network-vif-plugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:56:54 user nova-compute[70914]: WARNING nova.compute.manager [req-810b3a61-c3f3-4de2-96f6-f8f21f238cf0 req-c9d4acfa-5bba-4a4e-8fa1-753df6982d4d service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received unexpected event network-vif-plugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 for instance with vm_state building and task_state spawning.
Jul 27 13:56:54 user nova-compute[70914]: INFO nova.compute.manager [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Took 5.56 seconds to spawn the instance on the hypervisor.
Jul 27 13:56:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:56:54 user nova-compute[70914]: INFO nova.compute.manager [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Took 6.23 seconds to build instance.
Jul 27 13:56:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8d1fac84-6e2a-4e9b-aa3f-1c4a216d8302 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.352s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:56 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:56:56 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:56:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:56 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:56:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:56 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:56:58 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:56:58 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=25.133113861083984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "0d2398d7-3b4a-4543-a606-06efd18f41ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:58 user nova-compute[70914]: INFO nova.compute.manager [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Terminating instance
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cd4b9913-ab18-42d7-abd7-c4dad48375c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance fc2a646b-4612-44e3-b2c2-6c53fc65eef1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance b5734110-eb9c-4ba8-af64-351e5c8b59ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0d2398d7-3b4a-4543-a606-06efd18f41ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 39ea2b19-a667-4f90-91a9-c692d6f544fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-31aa6919-329e-4eb6-a47f-7dc28cfec5bb req-bc4b9e10-6a35-46da-8c36-31de7e27160c service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Received event network-vif-unplugged-31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-31aa6919-329e-4eb6-a47f-7dc28cfec5bb req-bc4b9e10-6a35-46da-8c36-31de7e27160c service nova] Acquiring lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-31aa6919-329e-4eb6-a47f-7dc28cfec5bb req-bc4b9e10-6a35-46da-8c36-31de7e27160c service nova] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-31aa6919-329e-4eb6-a47f-7dc28cfec5bb req-bc4b9e10-6a35-46da-8c36-31de7e27160c service nova] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-31aa6919-329e-4eb6-a47f-7dc28cfec5bb req-bc4b9e10-6a35-46da-8c36-31de7e27160c service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] No waiting events found dispatching network-vif-unplugged-31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.manager [req-31aa6919-329e-4eb6-a47f-7dc28cfec5bb req-bc4b9e10-6a35-46da-8c36-31de7e27160c service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Received event network-vif-unplugged-31dd19df-5a77-4cc1-973b-dc7602515196 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:56:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:56:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Instance destroyed successfully.
Jul 27 13:56:59 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'resources' on Instance uuid 0d2398d7-3b4a-4543-a606-06efd18f41ca {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-522404271',display_name='tempest-TestVolumeBootPattern-server-522404271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-522404271',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:55:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-a24wnjxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:55:26Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=0d2398d7-3b4a-4543-a606-06efd18f41ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31dd19df-5a77-4cc1-973b-dc7602515196", "address": "fa:16:3e:ea:18:93", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31dd19df-5a", "ovs_interfaceid": "31dd19df-5a77-4cc1-973b-dc7602515196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "31dd19df-5a77-4cc1-973b-dc7602515196", "address": "fa:16:3e:ea:18:93", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31dd19df-5a", "ovs_interfaceid": "31dd19df-5a77-4cc1-973b-dc7602515196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:93,bridge_name='br-int',has_traffic_filtering=True,id=31dd19df-5a77-4cc1-973b-dc7602515196,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31dd19df-5a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_vif [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:93,bridge_name='br-int',has_traffic_filtering=True,id=31dd19df-5a77-4cc1-973b-dc7602515196,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31dd19df-5a') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31dd19df-5a, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:56:59 user nova-compute[70914]: INFO os_vif [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:93,bridge_name='br-int',has_traffic_filtering=True,id=31dd19df-5a77-4cc1-973b-dc7602515196,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31dd19df-5a')
Jul 27 13:56:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHnWwIVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:56:59 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b3c2d6-3ee0-4322-abf0-ee720175f793]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:56:59 user nova-compute[70914]: No targets found.
Jul 27 13:56:59 user nova-compute[70914]: iSNS:
Jul 27 13:56:59 user nova-compute[70914]: No targets found.
Jul 27 13:56:59 user nova-compute[70914]: STATIC:
Jul 27 13:56:59 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382
Jul 27 13:56:59 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:56:59 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:56:59 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:56:59 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:56:59 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:56:59 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac
Jul 27 13:56:59 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:56:59 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:56:59 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd
Jul 27 13:56:59 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:56:59 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:56:59 user nova-compute[70914]: FIRMWARE:
Jul 27 13:56:59 user nova-compute[70914]: No targets found.
Jul 27 13:56:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:56:59 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:56:59 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8a4c89-319e-4df5-b72d-9690379b5321]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef96a4a7-0ab7-419a-a24c-3d4c34684e46]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:56:59 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:56:59 user nova-compute[70914]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)
Jul 27 13:56:59 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:56:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:56:59 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:56:59 user nova-compute[70914]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 (non-flash)
Jul 27 13:56:59 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:56:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c181a1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382'): ({'sdd'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Removing single pathed devices sdd {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abab9e0-d105-482a-8e08-d057e32ef389]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef406165-01fa-4598-b8f8-d2973607a45b]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flushing IO for device /dev/sdd {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc21206b-d182-457f-bbd8-1a636d232196]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5340f20e-a115-4988-a42d-26f9c5039f95]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ee65c7e8', '/dev/disk/by-id/scsi-23337393737373532', '/dev/disk/by-id/scsi-1SCST_BIOee65c7e8-3797775230449ae1') {{(pid=82182) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[457b6317-50af-4df4-ad26-32a4ad4a2b91]: (4, None) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd9769d-3ce8-48d0-ab6c-5ee201a80349]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ab9209-cb60-4086-a683-508ac666df3c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382, portal: 172.16.0.220,3260]
Jul 27 13:56:59 user nova-compute[70914]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382, portal: 172.16.0.220,3260] successful.
Jul 27 13:56:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b7fe3f-9c62-4d28-a1ca-0070899d8382 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3238773a-9de6-4a93-8322-8d8d2301873c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== disconnect_volume: return (351ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:56:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Deleting instance files /opt/stack/data/nova/instances/0d2398d7-3b4a-4543-a606-06efd18f41ca_del
Jul 27 13:56:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Deletion of /opt/stack/data/nova/instances/0d2398d7-3b4a-4543-a606-06efd18f41ca_del complete
Jul 27 13:56:59 user nova-compute[70914]: INFO nova.compute.manager [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:56:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:57:00 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Took 0.49 seconds to deallocate network for instance.
Jul 27 13:57:00 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Skipping network cache update for instance because it is being deleted. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG nova.compute.manager [req-36810cb3-48f3-4dc7-aa47-81eb252c1755 req-cca738bc-ddf3-4a71-a94f-ceb65ebe7862 service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Received event network-vif-plugged-31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-36810cb3-48f3-4dc7-aa47-81eb252c1755 req-cca738bc-ddf3-4a71-a94f-ceb65ebe7862 service nova] Acquiring lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-36810cb3-48f3-4dc7-aa47-81eb252c1755 req-cca738bc-ddf3-4a71-a94f-ceb65ebe7862 service nova] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-36810cb3-48f3-4dc7-aa47-81eb252c1755 req-cca738bc-ddf3-4a71-a94f-ceb65ebe7862 service nova] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:57:00 user nova-compute[70914]: DEBUG nova.compute.manager [req-36810cb3-48f3-4dc7-aa47-81eb252c1755 req-cca738bc-ddf3-4a71-a94f-ceb65ebe7862 service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] No waiting events found dispatching network-vif-plugged-31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:57:00 user nova-compute[70914]: WARNING nova.compute.manager [req-36810cb3-48f3-4dc7-aa47-81eb252c1755 req-cca738bc-ddf3-4a71-a94f-ceb65ebe7862 service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Received unexpected event network-vif-plugged-31dd19df-5a77-4cc1-973b-dc7602515196 for instance with vm_state active and task_state deleting.
Jul 27 13:57:00 user nova-compute[70914]: DEBUG nova.compute.manager [req-36810cb3-48f3-4dc7-aa47-81eb252c1755 req-cca738bc-ddf3-4a71-a94f-ceb65ebe7862 service nova] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Received event network-vif-deleted-31dd19df-5a77-4cc1-973b-dc7602515196 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:57:01 user nova-compute[70914]: INFO nova.compute.manager [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Took 0.78 seconds to detach 1 volumes for instance.
Jul 27 13:57:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Deleting volume: a9b7fe3f-9c62-4d28-a1ca-0070899d8382 {{(pid=70914) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 13:57:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Updating instance_info_cache with network_info: [{"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:57:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:57:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:57:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:57:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:57:01 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:57:01 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:57:01 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:57:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:57:01 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Deleted allocations for instance 0d2398d7-3b4a-4543-a606-06efd18f41ca
Jul 27 13:57:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3320639-ee8f-460d-8ac1-0869a6a3a93c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0d2398d7-3b4a-4543-a606-06efd18f41ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.145s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:57:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:57:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:14 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466219.3228757, 0d2398d7-3b4a-4543-a606-06efd18f41ca => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:57:14 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] VM Stopped (Lifecycle Event)
Jul 27 13:57:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-11ee7f08-7282-424e-b82d-e6b406641cce None None] [instance: 0d2398d7-3b4a-4543-a606-06efd18f41ca] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:57:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:57:19 user nova-compute[70914]: INFO nova.compute.manager [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Terminating instance
Jul 27 13:57:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-6093f833-f2a0-49e2-902d-ddfb4e9a79ef req-0c4e8c56-4fca-4a49-9bb1-2a30b4c83c57 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-unplugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6093f833-f2a0-49e2-902d-ddfb4e9a79ef req-0c4e8c56-4fca-4a49-9bb1-2a30b4c83c57 service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6093f833-f2a0-49e2-902d-ddfb4e9a79ef req-0c4e8c56-4fca-4a49-9bb1-2a30b4c83c57 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6093f833-f2a0-49e2-902d-ddfb4e9a79ef req-0c4e8c56-4fca-4a49-9bb1-2a30b4c83c57 service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-6093f833-f2a0-49e2-902d-ddfb4e9a79ef req-0c4e8c56-4fca-4a49-9bb1-2a30b4c83c57 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-unplugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-6093f833-f2a0-49e2-902d-ddfb4e9a79ef req-0c4e8c56-4fca-4a49-9bb1-2a30b4c83c57 service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-unplugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:20 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Instance destroyed successfully.
Jul 27 13:57:20 user nova-compute[70914]: DEBUG nova.objects.instance [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'resources' on Instance uuid fc2a646b-4612-44e3-b2c2-6c53fc65eef1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-521589190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-521589190',id=36,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:53:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-rpv2cmmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:55:33Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=fc2a646b-4612-44e3-b2c2-6c53fc65eef1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "address": "fa:16:3e:2f:4f:ed", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d96a87-1e", "ovs_interfaceid": "98d96a87-1eef-4e20-beef-a4f9e31205f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:4f:ed,bridge_name='br-int',has_traffic_filtering=True,id=98d96a87-1eef-4e20-beef-a4f9e31205f3,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d96a87-1e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_vif [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:4f:ed,bridge_name='br-int',has_traffic_filtering=True,id=98d96a87-1eef-4e20-beef-a4f9e31205f3,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d96a87-1e') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98d96a87-1e, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:57:20 user nova-compute[70914]: INFO os_vif [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:4f:ed,bridge_name='br-int',has_traffic_filtering=True,id=98d96a87-1eef-4e20-beef-a4f9e31205f3,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d96a87-1e')
Jul 27 13:57:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYnvQLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:57:20 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4682c1-9e38-466c-bbc5-1a17b585f707]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:57:20 user nova-compute[70914]: No targets found.
Jul 27 13:57:20 user nova-compute[70914]: iSNS:
Jul 27 13:57:20 user nova-compute[70914]: No targets found.
Jul 27 13:57:20 user nova-compute[70914]: STATIC:
Jul 27 13:57:20 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:57:20 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:57:20 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:57:20 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac
Jul 27 13:57:20 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:57:20 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:57:20 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd
Jul 27 13:57:20 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:57:20 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:57:20 user nova-compute[70914]: FIRMWARE:
Jul 27 13:57:20 user nova-compute[70914]: No targets found.
Jul 27 13:57:20 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:57:20 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:57:20 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e1284f-9a83-44fd-8db0-67cf1c282fef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfa8043-01f4-4117-800d-7cb669c06f21]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:57:20 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:57:20 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:57:20 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:57:20 user nova-compute[70914]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac (non-flash)
Jul 27 13:57:20 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:57:20 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c3c0bbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac'): ({'sdf'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Removing single pathed devices sdf {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e78626-68cd-4337-8b60-59e0b9701f21]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[59817f40-2043-45fa-9dca-c7487bc8aea6]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flushing IO for device /dev/sdf {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8d9f90-2b0f-4b03-b22d-f1d8512342a7]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61e48b-9955-4c9a-9c58-3c0842aa9205]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] SCSI volumes sdf have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26531643431386566', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a0ebbb32', '/dev/disk/by-id/scsi-1SCST_BIOa0ebbb32-e1d418ef4d2953a5') {{(pid=82182) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15b69c0-9642-4eb4-ab29-e899ce6e9cdd]: (4, None) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d47707-bbbb-4607-928d-27482f8e989e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f69776-1013-462a-a4a0-6b6e30290b61]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac, portal: 172.16.0.220,3260]
Jul 27 13:57:20 user nova-compute[70914]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac, portal: 172.16.0.220,3260] successful.
Jul 27 13:57:20 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:593c0e00-4003-4fe6-abca-df81c661f0ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2b1f05-97f0-440d-a0db-3f5fb71611a8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] <== disconnect_volume: return (315ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:57:20 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Deleting instance files /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1_del
Jul 27 13:57:20 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Deletion of /opt/stack/data/nova/instances/fc2a646b-4612-44e3-b2c2-6c53fc65eef1_del complete
Jul 27 13:57:20 user nova-compute[70914]: INFO nova.compute.manager [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 27 13:57:20 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:57:20 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:57:21 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:57:21 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Took 0.50 seconds to deallocate network for instance.
Jul 27 13:57:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-e19a8166-1d0c-406c-a254-298ab96c89b1 req-b13a6ae2-df74-487e-b919-ad7687d01e2a service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-deleted-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:57:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-d87d3ecd-9c72-4822-9b64-adff52dc53d0 req-d75e26ed-c964-4536-83b7-7a0616daa0db service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:57:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d87d3ecd-9c72-4822-9b64-adff52dc53d0 req-d75e26ed-c964-4536-83b7-7a0616daa0db service nova] Acquiring lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:57:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d87d3ecd-9c72-4822-9b64-adff52dc53d0 req-d75e26ed-c964-4536-83b7-7a0616daa0db service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:57:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d87d3ecd-9c72-4822-9b64-adff52dc53d0 req-d75e26ed-c964-4536-83b7-7a0616daa0db service nova] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:57:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-d87d3ecd-9c72-4822-9b64-adff52dc53d0 req-d75e26ed-c964-4536-83b7-7a0616daa0db service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] No waiting events found dispatching network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:57:21 user nova-compute[70914]: WARNING nova.compute.manager [req-d87d3ecd-9c72-4822-9b64-adff52dc53d0 req-d75e26ed-c964-4536-83b7-7a0616daa0db service nova] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Received unexpected event network-vif-plugged-98d96a87-1eef-4e20-beef-a4f9e31205f3 for instance with vm_state active and task_state deleting.
Jul 27 13:57:21 user nova-compute[70914]: INFO nova.compute.manager [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Took 0.75 seconds to detach 1 volumes for instance.
Jul 27 13:57:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:57:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:57:22 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:57:22 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:57:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:57:22 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Deleted allocations for instance fc2a646b-4612-44e3-b2c2-6c53fc65eef1
Jul 27 13:57:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-766c39dc-c853-4806-a77a-e42fd2704f09 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "fc2a646b-4612-44e3-b2c2-6c53fc65eef1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.099s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:57:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:57:35 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466240.296425, fc2a646b-4612-44e3-b2c2-6c53fc65eef1 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:57:35 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] VM Stopped (Lifecycle Event)
Jul 27 13:57:35 user nova-compute[70914]: DEBUG nova.compute.manager [None req-84d3ae1f-70b3-4eb5-864c-44fea036006d None None] [instance: fc2a646b-4612-44e3-b2c2-6c53fc65eef1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:57:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:57:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:57:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:57:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:57:35 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:57:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:45 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:57:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 13:57:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] There are 0 instances to clean {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 13:57:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:57:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:53 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:57:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:57 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:57:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:57:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:57:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:57:57 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:57:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:57 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:57:59 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:57:59 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:57:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8265MB free_disk=25.102001190185547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance cd4b9913-ab18-42d7-abd7-c4dad48375c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance b5734110-eb9c-4ba8-af64-351e5c8b59ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 39ea2b19-a667-4f90-91a9-c692d6f544fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:57:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:58:00 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:58:00 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:58:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:58:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:00 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:00 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:58:00 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Acquiring lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:58:01 user nova-compute[70914]: INFO nova.compute.claims [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Claim successful on node user
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:58:01 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:58:01 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Creating image(s)
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "/opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "/opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:01 user nova-compute[70914]: DEBUG nova.policy [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06a784798e9d4481baf69e090e6f2add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb04ba9df9d34da7879efc6d5ce31159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk 1073741824" returned: 0 in 0.055s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Cannot resize image /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG nova.objects.instance [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lazy-loading 'migration_context' on Instance uuid 0e2d383b-d56a-436f-89d8-7b3ed649f43f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Ensure instance console log exists: /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Successfully created port: 2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:58:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updating instance_info_cache with network_info: [{"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Successfully updated port: 2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Acquiring lock "refresh_cache-0e2d383b-d56a-436f-89d8-7b3ed649f43f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Acquired lock "refresh_cache-0e2d383b-d56a-436f-89d8-7b3ed649f43f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-086e140a-ca66-4fdb-8d53-c7dc6a454e21 req-9cf87429-ba8f-45f1-9f63-20af8041830c service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Received event network-changed-2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-086e140a-ca66-4fdb-8d53-c7dc6a454e21 req-9cf87429-ba8f-45f1-9f63-20af8041830c service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Refreshing instance network info cache due to event network-changed-2e64c413-542f-4225-a5ff-6dfdf651ff7a. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-086e140a-ca66-4fdb-8d53-c7dc6a454e21 req-9cf87429-ba8f-45f1-9f63-20af8041830c service nova] Acquiring lock "refresh_cache-0e2d383b-d56a-436f-89d8-7b3ed649f43f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Updating instance_info_cache with network_info: [{"id": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "address": "fa:16:3e:db:91:ee", "network": {"id": "93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1059486418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb04ba9df9d34da7879efc6d5ce31159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e64c413-54", "ovs_interfaceid": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Releasing lock "refresh_cache-0e2d383b-d56a-436f-89d8-7b3ed649f43f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Instance network_info: |[{"id": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "address": "fa:16:3e:db:91:ee", "network": {"id": "93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1059486418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb04ba9df9d34da7879efc6d5ce31159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e64c413-54", "ovs_interfaceid": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-086e140a-ca66-4fdb-8d53-c7dc6a454e21 req-9cf87429-ba8f-45f1-9f63-20af8041830c service nova] Acquired lock "refresh_cache-0e2d383b-d56a-436f-89d8-7b3ed649f43f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-086e140a-ca66-4fdb-8d53-c7dc6a454e21 req-9cf87429-ba8f-45f1-9f63-20af8041830c service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Refreshing network info cache for port 2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Start _get_guest_xml network_info=[{"id": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "address": "fa:16:3e:db:91:ee", "network": {"id": "93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1059486418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb04ba9df9d34da7879efc6d5ce31159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e64c413-54", "ovs_interfaceid": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:58:03 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:58:03 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:58:03 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-936014513',display_name='tempest-VolumesActionsTest-instance-936014513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-936014513',id=41,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb04ba9df9d34da7879efc6d5ce31159',ramdisk_id='',reservation_id='r-ayr24pth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1210862213',owner_user_name='tempest-VolumesActionsTest-1210862213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:58:02Z,user_data=None,user_id='06a784798e9d4481baf69e090e6f2add',uuid=0e2d383b-d56a-436f-89d8-7b3ed649f43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "address": "fa:16:3e:db:91:ee", "network": {"id": "93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1059486418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb04ba9df9d34da7879efc6d5ce31159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e64c413-54", "ovs_interfaceid": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Converting VIF {"id": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "address": "fa:16:3e:db:91:ee", "network": {"id": "93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1059486418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb04ba9df9d34da7879efc6d5ce31159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e64c413-54", "ovs_interfaceid": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e64c413-542f-4225-a5ff-6dfdf651ff7a,network=Network(93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e64c413-54') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.objects.instance [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e2d383b-d56a-436f-89d8-7b3ed649f43f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:58:04 user nova-compute[70914]:   <uuid>0e2d383b-d56a-436f-89d8-7b3ed649f43f</uuid>
Jul 27 13:58:04 user nova-compute[70914]:   <name>instance-00000029</name>
Jul 27 13:58:04 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:58:04 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:58:04 user nova-compute[70914]:   <metadata>
Jul 27 13:58:04 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:58:04 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:58:04 user nova-compute[70914]:       <nova:name>tempest-VolumesActionsTest-instance-936014513</nova:name>
Jul 27 13:58:04 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:58:03</nova:creationTime>
Jul 27 13:58:04 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:58:04 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:58:04 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:58:04 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:58:04 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:58:04 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:58:04 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:58:04 user nova-compute[70914]:       <nova:owner>
Jul 27 13:58:04 user nova-compute[70914]:         <nova:user uuid="06a784798e9d4481baf69e090e6f2add">tempest-VolumesActionsTest-1210862213-project-member</nova:user>
Jul 27 13:58:04 user nova-compute[70914]:         <nova:project uuid="bb04ba9df9d34da7879efc6d5ce31159">tempest-VolumesActionsTest-1210862213</nova:project>
Jul 27 13:58:04 user nova-compute[70914]:       </nova:owner>
Jul 27 13:58:04 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 13:58:04 user nova-compute[70914]:       <nova:ports>
Jul 27 13:58:04 user nova-compute[70914]:         <nova:port uuid="2e64c413-542f-4225-a5ff-6dfdf651ff7a">
Jul 27 13:58:04 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 13:58:04 user nova-compute[70914]:         </nova:port>
Jul 27 13:58:04 user nova-compute[70914]:       </nova:ports>
Jul 27 13:58:04 user nova-compute[70914]:     </nova:instance>
Jul 27 13:58:04 user nova-compute[70914]:   </metadata>
Jul 27 13:58:04 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:58:04 user nova-compute[70914]:     <system>
Jul 27 13:58:04 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:58:04 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:58:04 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:58:04 user nova-compute[70914]:       <entry name="serial">0e2d383b-d56a-436f-89d8-7b3ed649f43f</entry>
Jul 27 13:58:04 user nova-compute[70914]:       <entry name="uuid">0e2d383b-d56a-436f-89d8-7b3ed649f43f</entry>
Jul 27 13:58:04 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:58:04 user nova-compute[70914]:     </system>
Jul 27 13:58:04 user nova-compute[70914]:   </sysinfo>
Jul 27 13:58:04 user nova-compute[70914]:   <os>
Jul 27 13:58:04 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:58:04 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:58:04 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:58:04 user nova-compute[70914]:   </os>
Jul 27 13:58:04 user nova-compute[70914]:   <features>
Jul 27 13:58:04 user nova-compute[70914]:     <acpi/>
Jul 27 13:58:04 user nova-compute[70914]:     <apic/>
Jul 27 13:58:04 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:58:04 user nova-compute[70914]:   </features>
Jul 27 13:58:04 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:58:04 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:58:04 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:58:04 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:58:04 user nova-compute[70914]:   </clock>
Jul 27 13:58:04 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:58:04 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:58:04 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:58:04 user nova-compute[70914]:   </cpu>
Jul 27 13:58:04 user nova-compute[70914]:   <devices>
Jul 27 13:58:04 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 13:58:04 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 13:58:04 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk"/>
Jul 27 13:58:04 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:58:04 user nova-compute[70914]:     </disk>
Jul 27 13:58:04 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:58:04 user nova-compute[70914]:       <mac address="fa:16:3e:db:91:ee"/>
Jul 27 13:58:04 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:58:04 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:58:04 user nova-compute[70914]:       <target dev="tap2e64c413-54"/>
Jul 27 13:58:04 user nova-compute[70914]:     </interface>
Jul 27 13:58:04 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:58:04 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/console.log" append="off"/>
Jul 27 13:58:04 user nova-compute[70914]:     </serial>
Jul 27 13:58:04 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:58:04 user nova-compute[70914]:     <video>
Jul 27 13:58:04 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:58:04 user nova-compute[70914]:     </video>
Jul 27 13:58:04 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:58:04 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:58:04 user nova-compute[70914]:     </rng>
Jul 27 13:58:04 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:58:04 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:58:04 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:58:04 user nova-compute[70914]:     </memballoon>
Jul 27 13:58:04 user nova-compute[70914]:   </devices>
Jul 27 13:58:04 user nova-compute[70914]: </domain>
Jul 27 13:58:04 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-936014513',display_name='tempest-VolumesActionsTest-instance-936014513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-936014513',id=41,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb04ba9df9d34da7879efc6d5ce31159',ramdisk_id='',reservation_id='r-ayr24pth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1210862213',owner_user_name='tempest-VolumesActionsTest-1210862213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:58:02Z,user_data=None,user_id='06a784798e9d4481baf69e090e6f2add',uuid=0e2d383b-d56a-436f-89d8-7b3ed649f43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "address": "fa:16:3e:db:91:ee", "network": {"id": "93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1059486418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb04ba9df9d34da7879efc6d5ce31159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e64c413-54", "ovs_interfaceid": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Converting VIF {"id": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "address": "fa:16:3e:db:91:ee", "network": {"id": "93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1059486418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb04ba9df9d34da7879efc6d5ce31159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e64c413-54", "ovs_interfaceid": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e64c413-542f-4225-a5ff-6dfdf651ff7a,network=Network(93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e64c413-54') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG os_vif [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e64c413-542f-4225-a5ff-6dfdf651ff7a,network=Network(93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e64c413-54') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e64c413-54, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e64c413-54, col_values=(('external_ids', {'iface-id': '2e64c413-542f-4225-a5ff-6dfdf651ff7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:91:ee', 'vm-uuid': '0e2d383b-d56a-436f-89d8-7b3ed649f43f'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:04 user nova-compute[70914]: INFO os_vif [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e64c413-542f-4225-a5ff-6dfdf651ff7a,network=Network(93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e64c413-54')
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] No VIF found with MAC fa:16:3e:db:91:ee, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.network.neutron [req-086e140a-ca66-4fdb-8d53-c7dc6a454e21 req-9cf87429-ba8f-45f1-9f63-20af8041830c service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Updated VIF entry in instance network info cache for port 2e64c413-542f-4225-a5ff-6dfdf651ff7a. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.network.neutron [req-086e140a-ca66-4fdb-8d53-c7dc6a454e21 req-9cf87429-ba8f-45f1-9f63-20af8041830c service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Updating instance_info_cache with network_info: [{"id": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "address": "fa:16:3e:db:91:ee", "network": {"id": "93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1059486418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb04ba9df9d34da7879efc6d5ce31159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e64c413-54", "ovs_interfaceid": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-086e140a-ca66-4fdb-8d53-c7dc6a454e21 req-9cf87429-ba8f-45f1-9f63-20af8041830c service nova] Releasing lock "refresh_cache-0e2d383b-d56a-436f-89d8-7b3ed649f43f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances with incomplete migration  {{(pid=70914) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 13:58:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:05 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:05 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-58395c17-ec0e-4b92-992e-c2bdf3c4e791 req-ce42a6c6-db5b-4fbb-a31d-9932d33e6a87 service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Received event network-vif-plugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-58395c17-ec0e-4b92-992e-c2bdf3c4e791 req-ce42a6c6-db5b-4fbb-a31d-9932d33e6a87 service nova] Acquiring lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-58395c17-ec0e-4b92-992e-c2bdf3c4e791 req-ce42a6c6-db5b-4fbb-a31d-9932d33e6a87 service nova] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-58395c17-ec0e-4b92-992e-c2bdf3c4e791 req-ce42a6c6-db5b-4fbb-a31d-9932d33e6a87 service nova] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-58395c17-ec0e-4b92-992e-c2bdf3c4e791 req-ce42a6c6-db5b-4fbb-a31d-9932d33e6a87 service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] No waiting events found dispatching network-vif-plugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:58:05 user nova-compute[70914]: WARNING nova.compute.manager [req-58395c17-ec0e-4b92-992e-c2bdf3c4e791 req-ce42a6c6-db5b-4fbb-a31d-9932d33e6a87 service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Received unexpected event network-vif-plugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a for instance with vm_state building and task_state spawning.
Jul 27 13:58:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "8c04e796-5fed-4986-bd21-202b7bc843be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "8c04e796-5fed-4986-bd21-202b7bc843be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 13:58:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:58:06 user nova-compute[70914]: INFO nova.compute.claims [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Claim successful on node user
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 13:58:07 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 13:58:07 user nova-compute[70914]: INFO nova.virt.block_device [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Booting with volume cad2463a-7edc-4960-a1c9-9b8f79740283 at /dev/vda
Jul 27 13:58:07 user nova-compute[70914]: DEBUG os_brick.utils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a2e044-baf3-4891-b50d-693ebe4a4db5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d7e413-f310-4150-9fb4-3e225b479702]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9492437a-6e94-44f9-af15-c182df005bcd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[be87dd1f-8c4d-47e9-bea6-5147e37a7471]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.policy [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6161b1cf5fb4d08a8cbd36a93b8400c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ac071233d44fbb62e558725f63ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466287.704667, 0e2d383b-d56a-436f-89d8-7b3ed649f43f => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:58:07 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] VM Resumed (Lifecycle Event)
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:58:07 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbdf85d-80ff-44d3-8884-447c664b11d8]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG os_brick.utils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Updating existing volume attachment record: aa3a5d1b-d43c-4600-aee6-83018acc0157 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:07 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Instance spawned successfully.
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-772192bb-8504-44f1-9c17-43225f30754f req-f00fd6af-ecaf-4261-a2bc-b168aa390174 service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Received event network-vif-plugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-772192bb-8504-44f1-9c17-43225f30754f req-f00fd6af-ecaf-4261-a2bc-b168aa390174 service nova] Acquiring lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-772192bb-8504-44f1-9c17-43225f30754f req-f00fd6af-ecaf-4261-a2bc-b168aa390174 service nova] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-772192bb-8504-44f1-9c17-43225f30754f req-f00fd6af-ecaf-4261-a2bc-b168aa390174 service nova] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-772192bb-8504-44f1-9c17-43225f30754f req-f00fd6af-ecaf-4261-a2bc-b168aa390174 service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] No waiting events found dispatching network-vif-plugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:58:07 user nova-compute[70914]: WARNING nova.compute.manager [req-772192bb-8504-44f1-9c17-43225f30754f req-f00fd6af-ecaf-4261-a2bc-b168aa390174 service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Received unexpected event network-vif-plugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a for instance with vm_state building and task_state spawning.
Jul 27 13:58:07 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466287.7051291, 0e2d383b-d56a-436f-89d8-7b3ed649f43f => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:58:07 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] VM Started (Lifecycle Event)
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:58:07 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:58:07 user nova-compute[70914]: INFO nova.compute.manager [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Took 6.00 seconds to spawn the instance on the hypervisor.
Jul 27 13:58:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:07 user nova-compute[70914]: INFO nova.compute.manager [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Took 6.75 seconds to build instance.
Jul 27 13:58:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-e3979cf7-0fe1-44fc-ac82-c19bc22f88a9 tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.862s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "e595326a-2178-48d1-ba18-a703a76c23b9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:08 user nova-compute[70914]: INFO nova.compute.manager [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Unshelving
Jul 27 13:58:08 user nova-compute[70914]: INFO nova.virt.block_device [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Booting with volume 389ab7c2-1b59-4a14-955a-96eeb8f764b0 at /dev/vda
Jul 27 13:58:08 user nova-compute[70914]: DEBUG os_brick.utils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[118ac2c3-5abb-4701-954e-fa63a9002806]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[216d28ed-0770-4432-ac54-3109daf94e2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdd86c5-856d-4e30-87a2-2151938a3d1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d101e2-2c3f-4022-8acd-8f7b67156015]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 13:58:08 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 13:58:08 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7c0e87-8f64-468f-bc4e-fc77863c4be0]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG os_brick.utils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating existing volume attachment record: 178aade3-cbc5-4602-877c-a4341d37d774 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 13:58:08 user nova-compute[70914]: DEBUG nova.network.neutron [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Successfully created port: ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Successfully updated port: ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquired lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-a17c5a76-b87c-4fb5-bd65-2ef1d4e1cb81 req-452c6917-4def-46d8-809e-8a390898518d service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received event network-changed-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-a17c5a76-b87c-4fb5-bd65-2ef1d4e1cb81 req-452c6917-4def-46d8-809e-8a390898518d service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Refreshing instance network info cache due to event network-changed-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a17c5a76-b87c-4fb5-bd65-2ef1d4e1cb81 req-452c6917-4def-46d8-809e-8a390898518d service nova] Acquiring lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Updating instance_info_cache with network_info: [{"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Releasing lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Instance network_info: |[{"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a17c5a76-b87c-4fb5-bd65-2ef1d4e1cb81 req-452c6917-4def-46d8-809e-8a390898518d service nova] Acquired lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:58:09 user nova-compute[70914]: DEBUG nova.network.neutron [req-a17c5a76-b87c-4fb5-bd65-2ef1d4e1cb81 req-452c6917-4def-46d8-809e-8a390898518d service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Refreshing network info cache for port ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG nova.network.neutron [req-a17c5a76-b87c-4fb5-bd65-2ef1d4e1cb81 req-452c6917-4def-46d8-809e-8a390898518d service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Updated VIF entry in instance network info cache for port ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG nova.network.neutron [req-a17c5a76-b87c-4fb5-bd65-2ef1d4e1cb81 req-452c6917-4def-46d8-809e-8a390898518d service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Updating instance_info_cache with network_info: [{"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a17c5a76-b87c-4fb5-bd65-2ef1d4e1cb81 req-452c6917-4def-46d8-809e-8a390898518d service nova] Releasing lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:10 user nova-compute[70914]: INFO nova.compute.manager [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Terminating instance
Jul 27 13:58:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-14ada80e-7e55-48a8-a944-a4542931f4fa req-d8ed9ff9-f95f-4abc-8b2e-7c75f9cea64b service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Received event network-vif-unplugged-60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14ada80e-7e55-48a8-a944-a4542931f4fa req-d8ed9ff9-f95f-4abc-8b2e-7c75f9cea64b service nova] Acquiring lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14ada80e-7e55-48a8-a944-a4542931f4fa req-d8ed9ff9-f95f-4abc-8b2e-7c75f9cea64b service nova] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-14ada80e-7e55-48a8-a944-a4542931f4fa req-d8ed9ff9-f95f-4abc-8b2e-7c75f9cea64b service nova] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-14ada80e-7e55-48a8-a944-a4542931f4fa req-d8ed9ff9-f95f-4abc-8b2e-7c75f9cea64b service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] No waiting events found dispatching network-vif-unplugged-60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-14ada80e-7e55-48a8-a944-a4542931f4fa req-d8ed9ff9-f95f-4abc-8b2e-7c75f9cea64b service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Received event network-vif-unplugged-60f9c771-b526-401f-bd4e-6c0260665a85 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:10 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:11 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Instance destroyed successfully.
Jul 27 13:58:11 user nova-compute[70914]: DEBUG nova.objects.instance [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'resources' on Instance uuid cd4b9913-ab18-42d7-abd7-c4dad48375c6 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2145298011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2145298011',id=33,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:48:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-0ksdyyic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:50:44Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=cd4b9913-ab18-42d7-abd7-c4dad48375c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "60f9c771-b526-401f-bd4e-6c0260665a85", "address": "fa:16:3e:ab:f1:08", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f9c771-b5", "ovs_interfaceid": "60f9c771-b526-401f-bd4e-6c0260665a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:f1:08,bridge_name='br-int',has_traffic_filtering=True,id=60f9c771-b526-401f-bd4e-6c0260665a85,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f9c771-b5') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG os_vif [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:f1:08,bridge_name='br-int',has_traffic_filtering=True,id=60f9c771-b526-401f-bd4e-6c0260665a85,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f9c771-b5') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60f9c771-b5, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:58:11 user nova-compute[70914]: INFO os_vif [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:f1:08,bridge_name='br-int',has_traffic_filtering=True,id=60f9c771-b526-401f-bd4e-6c0260665a85,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f9c771-b5')
Jul 27 13:58:11 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Deleting instance files /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6_del
Jul 27 13:58:11 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Deletion of /opt/stack/data/nova/instances/cd4b9913-ab18-42d7-abd7-c4dad48375c6_del complete
Jul 27 13:58:11 user nova-compute[70914]: INFO nova.compute.manager [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 13:58:11 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:58:11 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Took 0.51 seconds to deallocate network for instance.
Jul 27 13:58:11 user nova-compute[70914]: DEBUG nova.compute.manager [req-78e46186-fc44-4361-921d-3f33fd88b69f req-9394f5bd-20c2-4b02-93f2-48ce14fbc878 service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Received event network-vif-deleted-60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:12 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:58:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:58:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:12 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Deleted allocations for instance cd4b9913-ab18-42d7-abd7-c4dad48375c6
Jul 27 13:58:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-fbd9b14d-6a1f-45b1-afb3-9d20ea86e9ba tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:12 user nova-compute[70914]: DEBUG nova.compute.manager [req-6ce8800b-6169-422a-9899-dd1c00945e5e req-ecf126f4-c41b-4082-b1ad-a740d5463b3f service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Received event network-vif-plugged-60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6ce8800b-6169-422a-9899-dd1c00945e5e req-ecf126f4-c41b-4082-b1ad-a740d5463b3f service nova] Acquiring lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6ce8800b-6169-422a-9899-dd1c00945e5e req-ecf126f4-c41b-4082-b1ad-a740d5463b3f service nova] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6ce8800b-6169-422a-9899-dd1c00945e5e req-ecf126f4-c41b-4082-b1ad-a740d5463b3f service nova] Lock "cd4b9913-ab18-42d7-abd7-c4dad48375c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:12 user nova-compute[70914]: DEBUG nova.compute.manager [req-6ce8800b-6169-422a-9899-dd1c00945e5e req-ecf126f4-c41b-4082-b1ad-a740d5463b3f service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] No waiting events found dispatching network-vif-plugged-60f9c771-b526-401f-bd4e-6c0260665a85 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:58:12 user nova-compute[70914]: WARNING nova.compute.manager [req-6ce8800b-6169-422a-9899-dd1c00945e5e req-ecf126f4-c41b-4082-b1ad-a740d5463b3f service nova] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Received unexpected event network-vif-plugged-60f9c771-b526-401f-bd4e-6c0260665a85 for instance with vm_state deleted and task_state None.
Jul 27 13:58:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.compute.manager [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:58:15 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Creating image(s)
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Ensure instance console log exists: /opt/stack/data/nova/instances/8c04e796-5fed-4986-bd21-202b7bc843be/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Start _get_guest_xml network_info=[{"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'aa3a5d1b-d43c-4600-aee6-83018acc0157', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFDoLhtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c04e796-5fed-4986-bd21-202b7bc843be', 'attached_at': '', 'detached_at': '', 'volume_id': 'cad2463a-7edc-4960-a1c9-9b8f79740283', 'serial': 'cad2463a-7edc-4960-a1c9-9b8f79740283'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:58:15 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:58:15 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFDoLhtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:58:15 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:58:15 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:58:15 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.objects.instance [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lazy-loading 'pci_requests' on Instance uuid e595326a-2178-48d1-ba18-a703a76c23b9 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.objects.instance [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lazy-loading 'numa_topology' on Instance uuid e595326a-2178-48d1-ba18-a703a76c23b9 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ccc72a-52c4-4e86-bcc5-8e6541441a54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:58:15 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 13:58:15 user nova-compute[70914]: INFO nova.compute.claims [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Claim successful on node user
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ffc5c4-6154-48e0-a0f0-2b2e58476f1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283] added
Jul 27 13:58:15 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9e5e25-9646-4408-9a96-5a756cda1463]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ffa33-967b-417d-a4cd-be65883d48bc]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFDoLhtS {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFDoLhtS" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ada07c-a1f5-44a9-ab90-10875f497caa]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFDoLhtS'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c380e8-e05b-4280-8984-c5d484c4237a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5bae3c-e3ee-49c1-90e2-87634cd1da9f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:58:15 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:58:15 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:58:15 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:58:15 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:58:15 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[09003c8c-7704-41a6-a519-f1023e4b66a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283, portal: 172.16.0.220,3260]
Jul 27 13:58:16 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283, portal: 172.16.0.220,3260] successful.
Jul 27 13:58:16 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f23e2d-5c0f-4403-88f7-ea079a04d9d9]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8526753-6b73-459f-a3ce-3106aa45c649]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:58:16 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:58:16 user nova-compute[70914]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 13:58:16 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:58:16 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:58:16 user nova-compute[70914]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 13:58:16 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52dc5ca-098e-4bfc-9203-bf16d2062168]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFDoLhtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:16 user nova-compute[70914]: INFO nova.network.neutron [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating port 1a00fbed-0a5c-49d1-800a-238f198d6411 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquired lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG nova.network.neutron [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG nova.compute.manager [req-7da5f8e5-1332-4262-81f7-b150846d3b5c req-57c5dbda-f03b-45ec-aa63-8ea7f2d26c27 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-changed-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG nova.compute.manager [req-7da5f8e5-1332-4262-81f7-b150846d3b5c req-57c5dbda-f03b-45ec-aa63-8ea7f2d26c27 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Refreshing instance network info cache due to event network-changed-1a00fbed-0a5c-49d1-800a-238f198d6411. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:58:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7da5f8e5-1332-4262-81f7-b150846d3b5c req-57c5dbda-f03b-45ec-aa63-8ea7f2d26c27 service nova] Acquiring lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26333303832373563', 'path': '/dev/sdd'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333303832373563', 'path': '/dev/sdd'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1989858646',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1989858646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1989858646',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJasvF4t0sCTZS7SU+YTdGcxrN7gWWatVzxXq5oTdl6Sh461wxdXhJsEUF4hPT/wJGdfA48Si9fInLOmFGIFVH+c6+FFujT0Oi9b2zS9ffeVis+1mdKIsMlUhU+zWZbHgg==',key_name='tempest-keypair-1917856352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-vc5imeth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=8c04e796-5fed-4986-bd21-202b7bc843be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b6390-aa') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.objects.instance [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c04e796-5fed-4986-bd21-202b7bc843be {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:58:17 user nova-compute[70914]:   <uuid>8c04e796-5fed-4986-bd21-202b7bc843be</uuid>
Jul 27 13:58:17 user nova-compute[70914]:   <name>instance-0000002a</name>
Jul 27 13:58:17 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:58:17 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:58:17 user nova-compute[70914]:   <metadata>
Jul 27 13:58:17 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:58:17 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:58:17 user nova-compute[70914]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1989858646</nova:name>
Jul 27 13:58:17 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:58:15</nova:creationTime>
Jul 27 13:58:17 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:58:17 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:58:17 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:58:17 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:58:17 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:58:17 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:58:17 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:58:17 user nova-compute[70914]:       <nova:owner>
Jul 27 13:58:17 user nova-compute[70914]:         <nova:user uuid="b6161b1cf5fb4d08a8cbd36a93b8400c">tempest-TestVolumeBootPattern-1923193575-project-member</nova:user>
Jul 27 13:58:17 user nova-compute[70914]:         <nova:project uuid="c73ac071233d44fbb62e558725f63ef8">tempest-TestVolumeBootPattern-1923193575</nova:project>
Jul 27 13:58:17 user nova-compute[70914]:       </nova:owner>
Jul 27 13:58:17 user nova-compute[70914]:       <nova:ports>
Jul 27 13:58:17 user nova-compute[70914]:         <nova:port uuid="ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76">
Jul 27 13:58:17 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 13:58:17 user nova-compute[70914]:         </nova:port>
Jul 27 13:58:17 user nova-compute[70914]:       </nova:ports>
Jul 27 13:58:17 user nova-compute[70914]:     </nova:instance>
Jul 27 13:58:17 user nova-compute[70914]:   </metadata>
Jul 27 13:58:17 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:58:17 user nova-compute[70914]:     <system>
Jul 27 13:58:17 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:58:17 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:58:17 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:58:17 user nova-compute[70914]:       <entry name="serial">8c04e796-5fed-4986-bd21-202b7bc843be</entry>
Jul 27 13:58:17 user nova-compute[70914]:       <entry name="uuid">8c04e796-5fed-4986-bd21-202b7bc843be</entry>
Jul 27 13:58:17 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:58:17 user nova-compute[70914]:     </system>
Jul 27 13:58:17 user nova-compute[70914]:   </sysinfo>
Jul 27 13:58:17 user nova-compute[70914]:   <os>
Jul 27 13:58:17 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:58:17 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:58:17 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:58:17 user nova-compute[70914]:   </os>
Jul 27 13:58:17 user nova-compute[70914]:   <features>
Jul 27 13:58:17 user nova-compute[70914]:     <acpi/>
Jul 27 13:58:17 user nova-compute[70914]:     <apic/>
Jul 27 13:58:17 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:58:17 user nova-compute[70914]:   </features>
Jul 27 13:58:17 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:58:17 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:58:17 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:58:17 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:58:17 user nova-compute[70914]:   </clock>
Jul 27 13:58:17 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:58:17 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:58:17 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:58:17 user nova-compute[70914]:   </cpu>
Jul 27 13:58:17 user nova-compute[70914]:   <devices>
Jul 27 13:58:17 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:58:17 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:58:17 user nova-compute[70914]:       <source dev="/dev/sdd"/>
Jul 27 13:58:17 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:58:17 user nova-compute[70914]:       <serial>cad2463a-7edc-4960-a1c9-9b8f79740283</serial>
Jul 27 13:58:17 user nova-compute[70914]:     </disk>
Jul 27 13:58:17 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:58:17 user nova-compute[70914]:       <mac address="fa:16:3e:f2:19:8c"/>
Jul 27 13:58:17 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:58:17 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:58:17 user nova-compute[70914]:       <target dev="tapff0b6390-aa"/>
Jul 27 13:58:17 user nova-compute[70914]:     </interface>
Jul 27 13:58:17 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:58:17 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/8c04e796-5fed-4986-bd21-202b7bc843be/console.log" append="off"/>
Jul 27 13:58:17 user nova-compute[70914]:     </serial>
Jul 27 13:58:17 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:58:17 user nova-compute[70914]:     <video>
Jul 27 13:58:17 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:58:17 user nova-compute[70914]:     </video>
Jul 27 13:58:17 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:58:17 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:58:17 user nova-compute[70914]:     </rng>
Jul 27 13:58:17 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:58:17 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:58:17 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:58:17 user nova-compute[70914]:     </memballoon>
Jul 27 13:58:17 user nova-compute[70914]:   </devices>
Jul 27 13:58:17 user nova-compute[70914]: </domain>
Jul 27 13:58:17 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1989858646',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1989858646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1989858646',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJasvF4t0sCTZS7SU+YTdGcxrN7gWWatVzxXq5oTdl6Sh461wxdXhJsEUF4hPT/wJGdfA48Si9fInLOmFGIFVH+c6+FFujT0Oi9b2zS9ffeVis+1mdKIsMlUhU+zWZbHgg==',key_name='tempest-keypair-1917856352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-vc5imeth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T13:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=8c04e796-5fed-4986-bd21-202b7bc843be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b6390-aa') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_vif [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b6390-aa') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff0b6390-aa, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff0b6390-aa, col_values=(('external_ids', {'iface-id': 'ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:19:8c', 'vm-uuid': '8c04e796-5fed-4986-bd21-202b7bc843be'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:17 user nova-compute[70914]: INFO os_vif [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b6390-aa')
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No VIF found with MAC fa:16:3e:f2:19:8c, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating instance_info_cache with network_info: [{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Releasing lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 13:58:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Creating image(s)
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Ensure instance console log exists: /opt/stack/data/nova/instances/e595326a-2178-48d1-ba18-a703a76c23b9/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Start _get_guest_xml network_info=[{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '178aade3-cbc5-4602-877c-a4341d37d774', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxOPtmKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e595326a-2178-48d1-ba18-a703a76c23b9', 'attached_at': '', 'detached_at': '', 'volume_id': '389ab7c2-1b59-4a14-955a-96eeb8f764b0', 'serial': '389ab7c2-1b59-4a14-955a-96eeb8f764b0'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7da5f8e5-1332-4262-81f7-b150846d3b5c req-57c5dbda-f03b-45ec-aa63-8ea7f2d26c27 service nova] Acquired lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.network.neutron [req-7da5f8e5-1332-4262-81f7-b150846d3b5c req-57c5dbda-f03b-45ec-aa63-8ea7f2d26c27 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Refreshing network info cache for port 1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:58:17 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:58:17 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.objects.instance [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lazy-loading 'vcpu_model' on Instance uuid e595326a-2178-48d1-ba18-a703a76c23b9 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxOPtmKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:58:17 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:58:17 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:58:17 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a016214-40dc-4236-a2bd-a70734b414d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 13:58:17 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e94f67-733c-4d15-889f-1ca34a0dd13d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0] added
Jul 27 13:58:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c54ecda-287d-46f4-bc50-309b5d354d37]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f6225d-3d46-4760-bd6c-1096c622f525]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxOPtmKp {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxOPtmKp" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2269532-61a1-41e3-be66-7428b4446c75]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FxOPtmKp'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc169832-05a2-4617-8a0f-d352af5b6c93]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadaf4d2-96c5-47f2-812b-c0fb5a97db5b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:58:17 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:58:17 user nova-compute[70914]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 13:58:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:58:17 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:58:17 user nova-compute[70914]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 13:58:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cbecd0-1a48-4457-a74e-f64fad992a56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260]
Jul 27 13:58:17 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260] successful.
Jul 27 13:58:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f160b34-b8bd-4c76-b071-688325af2c8f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[85777237-4739-4b54-aa55-f93ed4ee1591]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:58:17 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:58:17 user nova-compute[70914]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 13:58:17 user nova-compute[70914]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:58:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:58:17 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:58:17 user nova-compute[70914]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 13:58:17 user nova-compute[70914]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:58:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d371c3-22c9-4314-bfb0-d11709cb7650]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 13:58:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxOPtmKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.network.neutron [req-7da5f8e5-1332-4262-81f7-b150846d3b5c req-57c5dbda-f03b-45ec-aa63-8ea7f2d26c27 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updated VIF entry in instance network info cache for port 1a00fbed-0a5c-49d1-800a-238f198d6411. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.network.neutron [req-7da5f8e5-1332-4262-81f7-b150846d3b5c req-57c5dbda-f03b-45ec-aa63-8ea7f2d26c27 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating instance_info_cache with network_info: [{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-7da5f8e5-1332-4262-81f7-b150846d3b5c req-57c5dbda-f03b-45ec-aa63-8ea7f2d26c27 service nova] Releasing lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-e55bdfd7-fb88-4cf9-add7-545181e8b00b req-b14bf70f-cfd3-4c17-98ef-8235359e4ac2 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received event network-vif-plugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e55bdfd7-fb88-4cf9-add7-545181e8b00b req-b14bf70f-cfd3-4c17-98ef-8235359e4ac2 service nova] Acquiring lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e55bdfd7-fb88-4cf9-add7-545181e8b00b req-b14bf70f-cfd3-4c17-98ef-8235359e4ac2 service nova] Lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e55bdfd7-fb88-4cf9-add7-545181e8b00b req-b14bf70f-cfd3-4c17-98ef-8235359e4ac2 service nova] Lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-e55bdfd7-fb88-4cf9-add7-545181e8b00b req-b14bf70f-cfd3-4c17-98ef-8235359e4ac2 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] No waiting events found dispatching network-vif-plugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:58:18 user nova-compute[70914]: WARNING nova.compute.manager [req-e55bdfd7-fb88-4cf9-add7-545181e8b00b req-b14bf70f-cfd3-4c17-98ef-8235359e4ac2 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received unexpected event network-vif-plugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 for instance with vm_state building and task_state spawning.
Jul 27 13:58:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23834376534383537', 'path': '/dev/sde'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834376534383537', 'path': '/dev/sde'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-258381433',display_name='tempest-TestShelveInstance-server-258381433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-258381433',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-597209222',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5fc9d12d3f5942cc978d1b3636c29335',ramdisk_id='',reservation_id='r-g9ugvfau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1359726663',owner_user_name='tempest-TestShelveInstance-1359726663-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:58:08Z,user_data=None,user_id='bc9d168610c040b9b7931474e241c3f6',uuid=e595326a-2178-48d1-ba18-a703a76c23b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converting VIF {"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.objects.instance [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lazy-loading 'pci_devices' on Instance uuid e595326a-2178-48d1-ba18-a703a76c23b9 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 13:58:18 user nova-compute[70914]:   <uuid>e595326a-2178-48d1-ba18-a703a76c23b9</uuid>
Jul 27 13:58:18 user nova-compute[70914]:   <name>instance-00000025</name>
Jul 27 13:58:18 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 13:58:18 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 13:58:18 user nova-compute[70914]:   <metadata>
Jul 27 13:58:18 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 13:58:18 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 13:58:18 user nova-compute[70914]:       <nova:name>tempest-TestShelveInstance-server-258381433</nova:name>
Jul 27 13:58:18 user nova-compute[70914]:       <nova:creationTime>2023-07-27 13:58:17</nova:creationTime>
Jul 27 13:58:18 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 13:58:18 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 13:58:18 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 13:58:18 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 13:58:18 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 13:58:18 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 13:58:18 user nova-compute[70914]:       </nova:flavor>
Jul 27 13:58:18 user nova-compute[70914]:       <nova:owner>
Jul 27 13:58:18 user nova-compute[70914]:         <nova:user uuid="bc9d168610c040b9b7931474e241c3f6">tempest-TestShelveInstance-1359726663-project-member</nova:user>
Jul 27 13:58:18 user nova-compute[70914]:         <nova:project uuid="5fc9d12d3f5942cc978d1b3636c29335">tempest-TestShelveInstance-1359726663</nova:project>
Jul 27 13:58:18 user nova-compute[70914]:       </nova:owner>
Jul 27 13:58:18 user nova-compute[70914]:       <nova:ports>
Jul 27 13:58:18 user nova-compute[70914]:         <nova:port uuid="1a00fbed-0a5c-49d1-800a-238f198d6411">
Jul 27 13:58:18 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 13:58:18 user nova-compute[70914]:         </nova:port>
Jul 27 13:58:18 user nova-compute[70914]:       </nova:ports>
Jul 27 13:58:18 user nova-compute[70914]:     </nova:instance>
Jul 27 13:58:18 user nova-compute[70914]:   </metadata>
Jul 27 13:58:18 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 13:58:18 user nova-compute[70914]:     <system>
Jul 27 13:58:18 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 13:58:18 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 13:58:18 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 13:58:18 user nova-compute[70914]:       <entry name="serial">e595326a-2178-48d1-ba18-a703a76c23b9</entry>
Jul 27 13:58:18 user nova-compute[70914]:       <entry name="uuid">e595326a-2178-48d1-ba18-a703a76c23b9</entry>
Jul 27 13:58:18 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 13:58:18 user nova-compute[70914]:     </system>
Jul 27 13:58:18 user nova-compute[70914]:   </sysinfo>
Jul 27 13:58:18 user nova-compute[70914]:   <os>
Jul 27 13:58:18 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 13:58:18 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 13:58:18 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 13:58:18 user nova-compute[70914]:   </os>
Jul 27 13:58:18 user nova-compute[70914]:   <features>
Jul 27 13:58:18 user nova-compute[70914]:     <acpi/>
Jul 27 13:58:18 user nova-compute[70914]:     <apic/>
Jul 27 13:58:18 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 13:58:18 user nova-compute[70914]:   </features>
Jul 27 13:58:18 user nova-compute[70914]:   <clock offset="utc">
Jul 27 13:58:18 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 13:58:18 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 13:58:18 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 13:58:18 user nova-compute[70914]:   </clock>
Jul 27 13:58:18 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 13:58:18 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 13:58:18 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 13:58:18 user nova-compute[70914]:   </cpu>
Jul 27 13:58:18 user nova-compute[70914]:   <devices>
Jul 27 13:58:18 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 13:58:18 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:58:18 user nova-compute[70914]:       <source dev="/dev/sde"/>
Jul 27 13:58:18 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 13:58:18 user nova-compute[70914]:       <serial>389ab7c2-1b59-4a14-955a-96eeb8f764b0</serial>
Jul 27 13:58:18 user nova-compute[70914]:     </disk>
Jul 27 13:58:18 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 13:58:18 user nova-compute[70914]:       <mac address="fa:16:3e:92:8e:d3"/>
Jul 27 13:58:18 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:58:18 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 13:58:18 user nova-compute[70914]:       <target dev="tap1a00fbed-0a"/>
Jul 27 13:58:18 user nova-compute[70914]:     </interface>
Jul 27 13:58:18 user nova-compute[70914]:     <serial type="pty">
Jul 27 13:58:18 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/e595326a-2178-48d1-ba18-a703a76c23b9/console.log" append="off"/>
Jul 27 13:58:18 user nova-compute[70914]:     </serial>
Jul 27 13:58:18 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 13:58:18 user nova-compute[70914]:     <video>
Jul 27 13:58:18 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 13:58:18 user nova-compute[70914]:     </video>
Jul 27 13:58:18 user nova-compute[70914]:     <rng model="virtio">
Jul 27 13:58:18 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 13:58:18 user nova-compute[70914]:     </rng>
Jul 27 13:58:18 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 13:58:18 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 13:58:18 user nova-compute[70914]:       <stats period="10"/>
Jul 27 13:58:18 user nova-compute[70914]:     </memballoon>
Jul 27 13:58:18 user nova-compute[70914]:   </devices>
Jul 27 13:58:18 user nova-compute[70914]: </domain>
Jul 27 13:58:18 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-258381433',display_name='tempest-TestShelveInstance-server-258381433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-258381433',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-597209222',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5fc9d12d3f5942cc978d1b3636c29335',ramdisk_id='',reservation_id='r-g9ugvfau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1359726663',owner_user_name='tempest-TestShelveInstance-1359726663-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:58:08Z,user_data=None,user_id='bc9d168610c040b9b7931474e241c3f6',uuid=e595326a-2178-48d1-ba18-a703a76c23b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converting VIF {"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG os_vif [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a00fbed-0a, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a00fbed-0a, col_values=(('external_ids', {'iface-id': '1a00fbed-0a5c-49d1-800a-238f198d6411', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:8e:d3', 'vm-uuid': 'e595326a-2178-48d1-ba18-a703a76c23b9'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:58:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:18 user nova-compute[70914]: INFO os_vif [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a')
Jul 27 13:58:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 13:58:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] No VIF found with MAC fa:16:3e:92:8e:d3, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 13:58:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-32aa8b15-5ae0-417d-819d-cc632b492ba2 req-56cac74d-350b-4e8f-a7d5-73e643bd7ae2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-32aa8b15-5ae0-417d-819d-cc632b492ba2 req-56cac74d-350b-4e8f-a7d5-73e643bd7ae2 service nova] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-32aa8b15-5ae0-417d-819d-cc632b492ba2 req-56cac74d-350b-4e8f-a7d5-73e643bd7ae2 service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-32aa8b15-5ae0-417d-819d-cc632b492ba2 req-56cac74d-350b-4e8f-a7d5-73e643bd7ae2 service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-32aa8b15-5ae0-417d-819d-cc632b492ba2 req-56cac74d-350b-4e8f-a7d5-73e643bd7ae2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] No waiting events found dispatching network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:58:20 user nova-compute[70914]: WARNING nova.compute.manager [req-32aa8b15-5ae0-417d-819d-cc632b492ba2 req-56cac74d-350b-4e8f-a7d5-73e643bd7ae2 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received unexpected event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466300.738465, 8c04e796-5fed-4986-bd21-202b7bc843be => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:58:20 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] VM Resumed (Lifecycle Event)
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:58:20 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Instance spawned successfully.
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-fb3ccb50-784d-46eb-97cd-56a6f0584160 req-0b21b98c-cb92-4783-aede-170f8f15e440 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received event network-vif-plugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fb3ccb50-784d-46eb-97cd-56a6f0584160 req-0b21b98c-cb92-4783-aede-170f8f15e440 service nova] Acquiring lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fb3ccb50-784d-46eb-97cd-56a6f0584160 req-0b21b98c-cb92-4783-aede-170f8f15e440 service nova] Lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-fb3ccb50-784d-46eb-97cd-56a6f0584160 req-0b21b98c-cb92-4783-aede-170f8f15e440 service nova] Lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.compute.manager [req-fb3ccb50-784d-46eb-97cd-56a6f0584160 req-0b21b98c-cb92-4783-aede-170f8f15e440 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] No waiting events found dispatching network-vif-plugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:58:20 user nova-compute[70914]: WARNING nova.compute.manager [req-fb3ccb50-784d-46eb-97cd-56a6f0584160 req-0b21b98c-cb92-4783-aede-170f8f15e440 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received unexpected event network-vif-plugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 for instance with vm_state building and task_state spawning.
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:58:20 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466300.742333, 8c04e796-5fed-4986-bd21-202b7bc843be => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:58:20 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] VM Started (Lifecycle Event)
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:58:20 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:58:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:20 user nova-compute[70914]: INFO nova.compute.manager [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Took 5.30 seconds to spawn the instance on the hypervisor.
Jul 27 13:58:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:21 user nova-compute[70914]: INFO nova.compute.manager [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Took 14.26 seconds to build instance.
Jul 27 13:58:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-684e0ad4-6d4f-40af-aa66-82c9b7e4864c tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "8c04e796-5fed-4986-bd21-202b7bc843be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.354s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466302.5201347, e595326a-2178-48d1-ba18-a703a76c23b9 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:58:22 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] VM Resumed (Lifecycle Event)
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 13:58:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Instance spawned successfully.
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:58:22 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466302.52246, e595326a-2178-48d1-ba18-a703a76c23b9 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:58:22 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] VM Started (Lifecycle Event)
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-8e0f5197-dc60-4661-aaa4-ad53d6ab97d9 req-318d62ce-f5be-4067-978c-c300b01da883 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e0f5197-dc60-4661-aaa4-ad53d6ab97d9 req-318d62ce-f5be-4067-978c-c300b01da883 service nova] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e0f5197-dc60-4661-aaa4-ad53d6ab97d9 req-318d62ce-f5be-4067-978c-c300b01da883 service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8e0f5197-dc60-4661-aaa4-ad53d6ab97d9 req-318d62ce-f5be-4067-978c-c300b01da883 service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-8e0f5197-dc60-4661-aaa4-ad53d6ab97d9 req-318d62ce-f5be-4067-978c-c300b01da883 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] No waiting events found dispatching network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:58:22 user nova-compute[70914]: WARNING nova.compute.manager [req-8e0f5197-dc60-4661-aaa4-ad53d6ab97d9 req-318d62ce-f5be-4067-978c-c300b01da883 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received unexpected event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 13:58:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-99757314-35b8-4458-8c6b-9ef9db5699c0 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "e595326a-2178-48d1-ba18-a703a76c23b9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.478s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 13:58:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:26 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466291.187798, cd4b9913-ab18-42d7-abd7-c4dad48375c6 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:58:26 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] VM Stopped (Lifecycle Event)
Jul 27 13:58:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-ff3140fc-f5c6-4a68-8a37-9957bdb96f37 None None] [instance: cd4b9913-ab18-42d7-abd7-c4dad48375c6] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-451acbd4-3198-4ea4-af8d-f077e7c38ef2 req-380584ce-afee-44a3-9a1e-182c54705894 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received event network-changed-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-451acbd4-3198-4ea4-af8d-f077e7c38ef2 req-380584ce-afee-44a3-9a1e-182c54705894 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Refreshing instance network info cache due to event network-changed-4d277236-9aa3-44e5-8cd8-7b50e12bd663. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:58:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-451acbd4-3198-4ea4-af8d-f077e7c38ef2 req-380584ce-afee-44a3-9a1e-182c54705894 service nova] Acquiring lock "refresh_cache-39ea2b19-a667-4f90-91a9-c692d6f544fb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:58:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-451acbd4-3198-4ea4-af8d-f077e7c38ef2 req-380584ce-afee-44a3-9a1e-182c54705894 service nova] Acquired lock "refresh_cache-39ea2b19-a667-4f90-91a9-c692d6f544fb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:58:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-451acbd4-3198-4ea4-af8d-f077e7c38ef2 req-380584ce-afee-44a3-9a1e-182c54705894 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Refreshing network info cache for port 4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "39ea2b19-a667-4f90-91a9-c692d6f544fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:40 user nova-compute[70914]: INFO nova.compute.manager [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Terminating instance
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.network.neutron [req-451acbd4-3198-4ea4-af8d-f077e7c38ef2 req-380584ce-afee-44a3-9a1e-182c54705894 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Updated VIF entry in instance network info cache for port 4d277236-9aa3-44e5-8cd8-7b50e12bd663. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.network.neutron [req-451acbd4-3198-4ea4-af8d-f077e7c38ef2 req-380584ce-afee-44a3-9a1e-182c54705894 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Updating instance_info_cache with network_info: [{"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-451acbd4-3198-4ea4-af8d-f077e7c38ef2 req-380584ce-afee-44a3-9a1e-182c54705894 service nova] Releasing lock "refresh_cache-39ea2b19-a667-4f90-91a9-c692d6f544fb" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-adc3f8e2-2477-4d5a-ab8e-453451549d01 req-30e6d01e-3e05-4bd7-bdb7-ecd3559d5a48 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received event network-vif-unplugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-adc3f8e2-2477-4d5a-ab8e-453451549d01 req-30e6d01e-3e05-4bd7-bdb7-ecd3559d5a48 service nova] Acquiring lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-adc3f8e2-2477-4d5a-ab8e-453451549d01 req-30e6d01e-3e05-4bd7-bdb7-ecd3559d5a48 service nova] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-adc3f8e2-2477-4d5a-ab8e-453451549d01 req-30e6d01e-3e05-4bd7-bdb7-ecd3559d5a48 service nova] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-adc3f8e2-2477-4d5a-ab8e-453451549d01 req-30e6d01e-3e05-4bd7-bdb7-ecd3559d5a48 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] No waiting events found dispatching network-vif-unplugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-adc3f8e2-2477-4d5a-ab8e-453451549d01 req-30e6d01e-3e05-4bd7-bdb7-ecd3559d5a48 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received event network-vif-unplugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:58:40 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Instance destroyed successfully.
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.objects.instance [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'resources' on Instance uuid 39ea2b19-a667-4f90-91a9-c692d6f544fb {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-470809687',display_name='tempest-AttachVolumeNegativeTest-server-470809687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-470809687',id=40,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4q2Td3MXSeV4ultWdQjqC9PQNBdZmgFZLZP66H4N9nwGsm7Tp5honoYfGO6oabtlbhQKVXwSWMzR15cx9OQ12Fr/0svjN1hTLJMjhN+t4TLK4jhBvrYwMLWeZJaK9hog==',key_name='tempest-keypair-1748918594',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-ej9ut66y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:56:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=39ea2b19-a667-4f90-91a9-c692d6f544fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "address": "fa:16:3e:da:7c:3e", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d277236-9a", "ovs_interfaceid": "4d277236-9aa3-44e5-8cd8-7b50e12bd663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7c:3e,bridge_name='br-int',has_traffic_filtering=True,id=4d277236-9aa3-44e5-8cd8-7b50e12bd663,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d277236-9a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG os_vif [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7c:3e,bridge_name='br-int',has_traffic_filtering=True,id=4d277236-9aa3-44e5-8cd8-7b50e12bd663,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d277236-9a') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d277236-9a, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:58:40 user nova-compute[70914]: INFO os_vif [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7c:3e,bridge_name='br-int',has_traffic_filtering=True,id=4d277236-9aa3-44e5-8cd8-7b50e12bd663,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d277236-9a')
Jul 27 13:58:40 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Deleting instance files /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb_del
Jul 27 13:58:40 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Deletion of /opt/stack/data/nova/instances/39ea2b19-a667-4f90-91a9-c692d6f544fb_del complete
Jul 27 13:58:40 user nova-compute[70914]: INFO nova.compute.manager [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 27 13:58:40 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:58:40 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:58:41 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:58:41 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Took 0.86 seconds to deallocate network for instance.
Jul 27 13:58:41 user nova-compute[70914]: DEBUG nova.compute.manager [req-26a97c49-65ab-4bfc-8974-545732e3ae0f req-4e2d2f6a-49e6-4da6-b09d-9789fa928954 service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received event network-vif-deleted-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Refreshing inventories for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Updating ProviderTree inventory for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Refreshing aggregate associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, aggregates: None {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Refreshing trait associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:42 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Deleted allocations for instance 39ea2b19-a667-4f90-91a9-c692d6f544fb
Jul 27 13:58:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-db635801-4340-4ce0-85b0-2a4be20f4e14 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.393s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG nova.compute.manager [req-5daeed31-ecf6-4b0f-bf40-0cd57b73e581 req-52a6b8ec-bf8d-422b-ad32-45bf90eca02a service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received event network-vif-plugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5daeed31-ecf6-4b0f-bf40-0cd57b73e581 req-52a6b8ec-bf8d-422b-ad32-45bf90eca02a service nova] Acquiring lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5daeed31-ecf6-4b0f-bf40-0cd57b73e581 req-52a6b8ec-bf8d-422b-ad32-45bf90eca02a service nova] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-5daeed31-ecf6-4b0f-bf40-0cd57b73e581 req-52a6b8ec-bf8d-422b-ad32-45bf90eca02a service nova] Lock "39ea2b19-a667-4f90-91a9-c692d6f544fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:42 user nova-compute[70914]: DEBUG nova.compute.manager [req-5daeed31-ecf6-4b0f-bf40-0cd57b73e581 req-52a6b8ec-bf8d-422b-ad32-45bf90eca02a service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] No waiting events found dispatching network-vif-plugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:58:42 user nova-compute[70914]: WARNING nova.compute.manager [req-5daeed31-ecf6-4b0f-bf40-0cd57b73e581 req-52a6b8ec-bf8d-422b-ad32-45bf90eca02a service nova] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Received unexpected event network-vif-plugged-4d277236-9aa3-44e5-8cd8-7b50e12bd663 for instance with vm_state deleted and task_state None.
Jul 27 13:58:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:50 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_power_states {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid e595326a-2178-48d1-ba18-a703a76c23b9 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid b5734110-eb9c-4ba8-af64-351e5c8b59ef {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 0e2d383b-d56a-436f-89d8-7b3ed649f43f {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 8c04e796-5fed-4986-bd21-202b7bc843be {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "e595326a-2178-48d1-ba18-a703a76c23b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "8c04e796-5fed-4986-bd21-202b7bc843be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "8c04e796-5fed-4986-bd21-202b7bc843be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "e595326a-2178-48d1-ba18-a703a76c23b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "8c04e796-5fed-4986-bd21-202b7bc843be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:55 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:55 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466320.8184972, 39ea2b19-a667-4f90-91a9-c692d6f544fb => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:58:55 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] VM Stopped (Lifecycle Event)
Jul 27 13:58:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-af56d1d5-0339-4595-ac6c-8883f05bc0f7 None None] [instance: 39ea2b19-a667-4f90-91a9-c692d6f544fb] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:58:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:58:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:58:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:58:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:58:55 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:58:58 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:58 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:58:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:58:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:58:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:58:58 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:58:58 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:58:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:58:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 13:59:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:59:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8005MB free_disk=25.19925308227539GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance b5734110-eb9c-4ba8-af64-351e5c8b59ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0e2d383b-d56a-436f-89d8-7b3ed649f43f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8c04e796-5fed-4986-bd21-202b7bc843be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e595326a-2178-48d1-ba18-a703a76c23b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:00 user nova-compute[70914]: INFO nova.compute.manager [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Terminating instance
Jul 27 13:59:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:59:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-d30f7539-47c5-47cf-96c4-11ee476cb5f0 req-a2348de2-57f0-44ef-9e9f-878724182223 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-unplugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d30f7539-47c5-47cf-96c4-11ee476cb5f0 req-a2348de2-57f0-44ef-9e9f-878724182223 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d30f7539-47c5-47cf-96c4-11ee476cb5f0 req-a2348de2-57f0-44ef-9e9f-878724182223 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d30f7539-47c5-47cf-96c4-11ee476cb5f0 req-a2348de2-57f0-44ef-9e9f-878724182223 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-d30f7539-47c5-47cf-96c4-11ee476cb5f0 req-a2348de2-57f0-44ef-9e9f-878724182223 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-unplugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG nova.compute.manager [req-d30f7539-47c5-47cf-96c4-11ee476cb5f0 req-a2348de2-57f0-44ef-9e9f-878724182223 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-unplugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:01 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Instance destroyed successfully.
Jul 27 13:59:01 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'resources' on Instance uuid 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-31353135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-31353135',id=27,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:45:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-bbhk20d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:46:59Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=45a01fa6-81c7-4f78-83a8-83fb11cdb1cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "0976e6f9-568a-42b8-8b0e-b135d2203749", "address": "fa:16:3e:9a:cb:32", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976e6f9-56", "ovs_interfaceid": "0976e6f9-568a-42b8-8b0e-b135d2203749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:cb:32,bridge_name='br-int',has_traffic_filtering=True,id=0976e6f9-568a-42b8-8b0e-b135d2203749,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976e6f9-56') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_vif [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:cb:32,bridge_name='br-int',has_traffic_filtering=True,id=0976e6f9-568a-42b8-8b0e-b135d2203749,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976e6f9-56') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0976e6f9-56, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:59:01 user nova-compute[70914]: INFO os_vif [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:cb:32,bridge_name='br-int',has_traffic_filtering=True,id=0976e6f9-568a-42b8-8b0e-b135d2203749,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976e6f9-56')
Jul 27 13:59:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAqoEYwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:59:01 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9ca561-76f6-4686-a05f-cc4968dcecd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:59:01 user nova-compute[70914]: No targets found.
Jul 27 13:59:01 user nova-compute[70914]: iSNS:
Jul 27 13:59:01 user nova-compute[70914]: No targets found.
Jul 27 13:59:01 user nova-compute[70914]: STATIC:
Jul 27 13:59:01 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283
Jul 27 13:59:01 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:59:01 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:59:01 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc
Jul 27 13:59:01 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:59:01 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:59:01 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0
Jul 27 13:59:01 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:59:01 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:59:01 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd
Jul 27 13:59:01 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:59:01 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:59:01 user nova-compute[70914]: FIRMWARE:
Jul 27 13:59:01 user nova-compute[70914]: No targets found.
Jul 27 13:59:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:59:01 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:59:01 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baf4da5-7f08-475b-bdb6-714e3bf9d530]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32ce28d-dcc8-4d92-ac2e-a718ff90de5f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:59:01 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:59:01 user nova-compute[70914]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 13:59:01 user nova-compute[70914]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:59:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc (non-flash)
Jul 27 13:59:01 user nova-compute[70914]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:59:01 user nova-compute[70914]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 13:59:01 user nova-compute[70914]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:59:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf86d40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc'): ({'sdc'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Removing single pathed devices sdc {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb81021-1b31-490c-ac34-e1333e059e84]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49f4f7f-aa2b-454b-9111-53d92c199e62]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Flushing IO for device /dev/sdc {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b036b6-31f9-4cd6-a2cc-3589eecfd599]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fce6a6-0dde-4a3e-9281-34a39789de4f]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.049s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb711319-4fd9-41e2-8aa4-69f50e5ff2e5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca37389-b7e0-4ccf-95d1-fee64f843a68]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc, portal: 172.16.0.220,3260]
Jul 27 13:59:01 user nova-compute[70914]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc, portal: 172.16.0.220,3260] successful.
Jul 27 13:59:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1450a005-ef4f-4fc8-a2a2-6920e8f921bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4f3fcf-8269-4e5f-9d8c-eeefbc6d3bf1]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] <== disconnect_volume: return (331ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:59:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:59:01 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Deleting instance files /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc_del
Jul 27 13:59:01 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Deletion of /opt/stack/data/nova/instances/45a01fa6-81c7-4f78-83a8-83fb11cdb1cc_del complete
Jul 27 13:59:02 user nova-compute[70914]: INFO nova.compute.manager [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 27 13:59:02 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:59:02 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:59:02 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:59:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:59:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 13:59:02 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:59:02 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Took 0.54 seconds to deallocate network for instance.
Jul 27 13:59:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:59:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:59:02 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-6045ba38-a6ef-4f51-995e-2b7cd26dcd03 req-be6b4521-0f5a-4b6a-86e6-c07868c1f3c0 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6045ba38-a6ef-4f51-995e-2b7cd26dcd03 req-be6b4521-0f5a-4b6a-86e6-c07868c1f3c0 service nova] Acquiring lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6045ba38-a6ef-4f51-995e-2b7cd26dcd03 req-be6b4521-0f5a-4b6a-86e6-c07868c1f3c0 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6045ba38-a6ef-4f51-995e-2b7cd26dcd03 req-be6b4521-0f5a-4b6a-86e6-c07868c1f3c0 service nova] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-6045ba38-a6ef-4f51-995e-2b7cd26dcd03 req-be6b4521-0f5a-4b6a-86e6-c07868c1f3c0 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] No waiting events found dispatching network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:59:03 user nova-compute[70914]: WARNING nova.compute.manager [req-6045ba38-a6ef-4f51-995e-2b7cd26dcd03 req-be6b4521-0f5a-4b6a-86e6-c07868c1f3c0 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received unexpected event network-vif-plugged-0976e6f9-568a-42b8-8b0e-b135d2203749 for instance with vm_state active and task_state deleting.
Jul 27 13:59:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-6045ba38-a6ef-4f51-995e-2b7cd26dcd03 req-be6b4521-0f5a-4b6a-86e6-c07868c1f3c0 service nova] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Received event network-vif-deleted-0976e6f9-568a-42b8-8b0e-b135d2203749 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Updating instance_info_cache with network_info: [{"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-b5734110-eb9c-4ba8-af64-351e5c8b59ef" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 13:59:03 user nova-compute[70914]: INFO nova.compute.manager [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Took 0.78 seconds to detach 1 volumes for instance.
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:03 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Deleted allocations for instance 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc
Jul 27 13:59:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a777bfee-9fa9-4ae1-bd13-2b31c5e5c6d5 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "45a01fa6-81c7-4f78-83a8-83fb11cdb1cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.897s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:06 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:59:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:59:16 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466341.6139035, 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 13:59:16 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] VM Stopped (Lifecycle Event)
Jul 27 13:59:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b36f5cc1-09c4-45d8-aec4-46daac7e2857 None None] [instance: 45a01fa6-81c7-4f78-83a8-83fb11cdb1cc] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:59:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:59:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:59:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:31 user nova-compute[70914]: INFO nova.compute.manager [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Detaching volume f7727af1-e3ca-42c1-a372-1ea9cd5eccfd
Jul 27 13:59:31 user nova-compute[70914]: INFO nova.virt.block_device [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Attempting to driver detach volume f7727af1-e3ca-42c1-a372-1ea9cd5eccfd from mountpoint /dev/vdb
Jul 27 13:59:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Attempting to detach device vdb from instance b5734110-eb9c-4ba8-af64-351e5c8b59ef from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 13:59:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:59:31 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:59:31 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:59:31 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:59:31 user nova-compute[70914]:   <serial>f7727af1-e3ca-42c1-a372-1ea9cd5eccfd</serial>
Jul 27 13:59:31 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:59:31 user nova-compute[70914]: </disk>
Jul 27 13:59:31 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:59:31 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully detached device vdb from instance b5734110-eb9c-4ba8-af64-351e5c8b59ef from the persistent domain config.
Jul 27 13:59:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5734110-eb9c-4ba8-af64-351e5c8b59ef from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 13:59:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 13:59:31 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 13:59:31 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 13:59:31 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 13:59:31 user nova-compute[70914]:   <serial>f7727af1-e3ca-42c1-a372-1ea9cd5eccfd</serial>
Jul 27 13:59:31 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 13:59:31 user nova-compute[70914]: </disk>
Jul 27 13:59:31 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 13:59:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:59:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 13:59:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:59:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 13:59:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690466372.0255134, b5734110-eb9c-4ba8-af64-351e5c8b59ef => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5734110-eb9c-4ba8-af64-351e5c8b59ef {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 13:59:32 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully detached device vdb from instance b5734110-eb9c-4ba8-af64-351e5c8b59ef from the live domain config.
Jul 27 13:59:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqemuQpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 13:59:32 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e28117-d787-400e-9949-513685b6ddb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 13:59:32 user nova-compute[70914]: No targets found.
Jul 27 13:59:32 user nova-compute[70914]: iSNS:
Jul 27 13:59:32 user nova-compute[70914]: No targets found.
Jul 27 13:59:32 user nova-compute[70914]: STATIC:
Jul 27 13:59:32 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283
Jul 27 13:59:32 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:59:32 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:59:32 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0
Jul 27 13:59:32 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:59:32 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:59:32 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd
Jul 27 13:59:32 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 13:59:32 user nova-compute[70914]:                 Iface Name: default
Jul 27 13:59:32 user nova-compute[70914]: FIRMWARE:
Jul 27 13:59:32 user nova-compute[70914]: No targets found.
Jul 27 13:59:32 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 13:59:32 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 13:59:32 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b98908-0de5-41c3-8793-5b0484e1cbb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d3f43b-28cf-46ce-8358-c8bb2f71fa43]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:59:32 user nova-compute[70914]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 13:59:32 user nova-compute[70914]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:59:32 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd (non-flash)
Jul 27 13:59:32 user nova-compute[70914]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 13:59:32 user nova-compute[70914]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 13:59:32 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18172b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf30cd2c-34fb-43a5-b57b-78c0ae70bb2c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cc8c82-6e95-4afc-8418-7c13505f54e4]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ad9aba-e62a-430e-94d8-aace88a9aa35]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2639de18-23fc-4583-bbce-f58bbd529d3e]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2a63a4-2f52-4e19-b7f7-0de6bea4d991]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68e770f-3ae4-41d6-9800-4fda5084d6d8]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd, portal: 172.16.0.220,3260]
Jul 27 13:59:32 user nova-compute[70914]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd, portal: 172.16.0.220,3260] successful.
Jul 27 13:59:32 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7727af1-e3ca-42c1-a372-1ea9cd5eccfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee65ac2-7e51-42c4-8634-4ba1ff5d3a30]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] <== disconnect_volume: return (311ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 13:59:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 13:59:33 user nova-compute[70914]: DEBUG nova.objects.instance [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'flavor' on Instance uuid b5734110-eb9c-4ba8-af64-351e5c8b59ef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:59:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-953fa7a8-f104-4b76-9e3b-e8c52c23a717 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:59:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:59:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:59:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:51 user nova-compute[70914]: INFO nova.compute.manager [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Terminating instance
Jul 27 13:59:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:59:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-88c373ab-c201-4cb4-a663-c68bebefd817 req-913706f1-7ad7-404e-8c7f-1eb7cd3ce555 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Received event network-vif-unplugged-90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-88c373ab-c201-4cb4-a663-c68bebefd817 req-913706f1-7ad7-404e-8c7f-1eb7cd3ce555 service nova] Acquiring lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-88c373ab-c201-4cb4-a663-c68bebefd817 req-913706f1-7ad7-404e-8c7f-1eb7cd3ce555 service nova] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-88c373ab-c201-4cb4-a663-c68bebefd817 req-913706f1-7ad7-404e-8c7f-1eb7cd3ce555 service nova] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-88c373ab-c201-4cb4-a663-c68bebefd817 req-913706f1-7ad7-404e-8c7f-1eb7cd3ce555 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] No waiting events found dispatching network-vif-unplugged-90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG nova.compute.manager [req-88c373ab-c201-4cb4-a663-c68bebefd817 req-913706f1-7ad7-404e-8c7f-1eb7cd3ce555 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Received event network-vif-unplugged-90afa138-9668-43f0-8c38-3789741da9da for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:52 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Instance destroyed successfully.
Jul 27 13:59:52 user nova-compute[70914]: DEBUG nova.objects.instance [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lazy-loading 'resources' on Instance uuid 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-211190651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-211190651',id=20,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:40:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9647080d1194d60aeb390b127895474',ramdisk_id='',reservation_id='r-7gk2hxpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-853279030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:42:09Z,user_data=None,user_id='89bc44e787074838ba46afd3f81262f0',uuid=8a2674b5-adaf-4195-bbce-9d48fa1fa4e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converting VIF {"id": "90afa138-9668-43f0-8c38-3789741da9da", "address": "fa:16:3e:44:40:61", "network": {"id": "a13468dc-d18c-4be8-aa61-d98a3f7bb02c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705489706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9647080d1194d60aeb390b127895474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90afa138-96", "ovs_interfaceid": "90afa138-9668-43f0-8c38-3789741da9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:40:61,bridge_name='br-int',has_traffic_filtering=True,id=90afa138-9668-43f0-8c38-3789741da9da,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90afa138-96') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG os_vif [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:40:61,bridge_name='br-int',has_traffic_filtering=True,id=90afa138-9668-43f0-8c38-3789741da9da,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90afa138-96') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90afa138-96, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:59:52 user nova-compute[70914]: INFO os_vif [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:40:61,bridge_name='br-int',has_traffic_filtering=True,id=90afa138-9668-43f0-8c38-3789741da9da,network=Network(a13468dc-d18c-4be8-aa61-d98a3f7bb02c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90afa138-96')
Jul 27 13:59:52 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Deleting instance files /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6_del
Jul 27 13:59:52 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Deletion of /opt/stack/data/nova/instances/8a2674b5-adaf-4195-bbce-9d48fa1fa4e6_del complete
Jul 27 13:59:52 user nova-compute[70914]: INFO nova.compute.manager [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 27 13:59:52 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:59:52 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:59:53 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:59:53 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Took 1.21 seconds to deallocate network for instance.
Jul 27 13:59:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-d6332f79-36e7-4109-86b4-5aaed7f42d8b req-796c3e37-2c4d-4909-914f-81e96446d1a1 service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Received event network-vif-deleted-90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:59:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:53 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:59:53 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:59:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:54 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Deleted allocations for instance 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6
Jul 27 13:59:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-c5aaa18b-93ab-4b43-837b-39f3a7e189c5 req-91f31839-9bdf-4e5b-864d-f8817a04dfea service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Received event network-vif-plugged-90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:59:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c5aaa18b-93ab-4b43-837b-39f3a7e189c5 req-91f31839-9bdf-4e5b-864d-f8817a04dfea service nova] Acquiring lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c5aaa18b-93ab-4b43-837b-39f3a7e189c5 req-91f31839-9bdf-4e5b-864d-f8817a04dfea service nova] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c5aaa18b-93ab-4b43-837b-39f3a7e189c5 req-91f31839-9bdf-4e5b-864d-f8817a04dfea service nova] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-c5aaa18b-93ab-4b43-837b-39f3a7e189c5 req-91f31839-9bdf-4e5b-864d-f8817a04dfea service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] No waiting events found dispatching network-vif-plugged-90afa138-9668-43f0-8c38-3789741da9da {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:59:54 user nova-compute[70914]: WARNING nova.compute.manager [req-c5aaa18b-93ab-4b43-837b-39f3a7e189c5 req-91f31839-9bdf-4e5b-864d-f8817a04dfea service nova] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Received unexpected event network-vif-plugged-90afa138-9668-43f0-8c38-3789741da9da for instance with vm_state deleted and task_state None.
Jul 27 13:59:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-937cbef7-71a1-464c-b1fa-e297a8849077 tempest-ServerBootFromVolumeStableRescueTest-853279030 tempest-ServerBootFromVolumeStableRescueTest-853279030-project-member] Lock "8a2674b5-adaf-4195-bbce-9d48fa1fa4e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.515s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:59:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:57 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:59:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-ebbdfe8b-2e45-4974-8ff9-e25537324886 req-31025d93-72ad-4e32-98b7-aa6eea23dac2 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received event network-changed-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:59:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-ebbdfe8b-2e45-4974-8ff9-e25537324886 req-31025d93-72ad-4e32-98b7-aa6eea23dac2 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Refreshing instance network info cache due to event network-changed-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:59:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ebbdfe8b-2e45-4974-8ff9-e25537324886 req-31025d93-72ad-4e32-98b7-aa6eea23dac2 service nova] Acquiring lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:59:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ebbdfe8b-2e45-4974-8ff9-e25537324886 req-31025d93-72ad-4e32-98b7-aa6eea23dac2 service nova] Acquired lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:59:57 user nova-compute[70914]: DEBUG nova.network.neutron [req-ebbdfe8b-2e45-4974-8ff9-e25537324886 req-31025d93-72ad-4e32-98b7-aa6eea23dac2 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Refreshing network info cache for port ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:59:58 user nova-compute[70914]: DEBUG nova.network.neutron [req-ebbdfe8b-2e45-4974-8ff9-e25537324886 req-31025d93-72ad-4e32-98b7-aa6eea23dac2 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Updated VIF entry in instance network info cache for port ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 13:59:58 user nova-compute[70914]: DEBUG nova.network.neutron [req-ebbdfe8b-2e45-4974-8ff9-e25537324886 req-31025d93-72ad-4e32-98b7-aa6eea23dac2 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Updating instance_info_cache with network_info: [{"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:59:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ebbdfe8b-2e45-4974-8ff9-e25537324886 req-31025d93-72ad-4e32-98b7-aa6eea23dac2 service nova] Releasing lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-d9f2519c-d643-45b2-8425-ea51d495c6e8 req-2a9f9038-66c7-48e7-a670-9d2732227c34 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-changed-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-d9f2519c-d643-45b2-8425-ea51d495c6e8 req-2a9f9038-66c7-48e7-a670-9d2732227c34 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Refreshing instance network info cache due to event network-changed-1a00fbed-0a5c-49d1-800a-238f198d6411. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d9f2519c-d643-45b2-8425-ea51d495c6e8 req-2a9f9038-66c7-48e7-a670-9d2732227c34 service nova] Acquiring lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d9f2519c-d643-45b2-8425-ea51d495c6e8 req-2a9f9038-66c7-48e7-a670-9d2732227c34 service nova] Acquired lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG nova.network.neutron [req-d9f2519c-d643-45b2-8425-ea51d495c6e8 req-2a9f9038-66c7-48e7-a670-9d2732227c34 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Refreshing network info cache for port 1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "e595326a-2178-48d1-ba18-a703a76c23b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 13:59:59 user nova-compute[70914]: INFO nova.compute.manager [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Terminating instance
Jul 27 13:59:59 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:59:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.compute.manager [req-183be79d-a7ff-47d7-853a-4f96178c2d87 req-f77c5050-c4a1-4d89-8a76-135a86e624bc service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-vif-unplugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-183be79d-a7ff-47d7-853a-4f96178c2d87 req-f77c5050-c4a1-4d89-8a76-135a86e624bc service nova] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-183be79d-a7ff-47d7-853a-4f96178c2d87 req-f77c5050-c4a1-4d89-8a76-135a86e624bc service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-183be79d-a7ff-47d7-853a-4f96178c2d87 req-f77c5050-c4a1-4d89-8a76-135a86e624bc service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.compute.manager [req-183be79d-a7ff-47d7-853a-4f96178c2d87 req-f77c5050-c4a1-4d89-8a76-135a86e624bc service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] No waiting events found dispatching network-vif-unplugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.compute.manager [req-183be79d-a7ff-47d7-853a-4f96178c2d87 req-f77c5050-c4a1-4d89-8a76-135a86e624bc service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-vif-unplugged-1a00fbed-0a5c-49d1-800a-238f198d6411 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:00:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Instance destroyed successfully.
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lazy-loading 'resources' on Instance uuid e595326a-2178-48d1-ba18-a703a76c23b9 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T13:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-258381433',display_name='tempest-TestShelveInstance-server-258381433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-258381433',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWePivK+ohgjpS7ULQzMfaCzLUyr/7CHWKxilUPtHxYrRlp72yp93hD1Z5eSxIa4WP8mEJqldom5IIAc+OdNMzBZHqjbe9xt5xD6TsxEiBwtF+4H4rTwdUm8eS/uyZT/g==',key_name='tempest-TestShelveInstance-597209222',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:58:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fc9d12d3f5942cc978d1b3636c29335',ramdisk_id='',reservation_id='r-g9ugvfau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1359726663',owner_user_name='tempest-TestShelveInstance-1359726663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:58:23Z,user_data=None,user_id='bc9d168610c040b9b7931474e241c3f6',uuid=e595326a-2178-48d1-ba18-a703a76c23b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converting VIF {"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_vif [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a00fbed-0a, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:00:00 user nova-compute[70914]: INFO os_vif [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:d3,bridge_name='br-int',has_traffic_filtering=True,id=1a00fbed-0a5c-49d1-800a-238f198d6411,network=Network(cd2a0e0a-d404-4f81-9a3c-783f8a102521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a00fbed-0a')
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxOPtmKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:00:00 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.network.neutron [req-d9f2519c-d643-45b2-8425-ea51d495c6e8 req-2a9f9038-66c7-48e7-a670-9d2732227c34 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updated VIF entry in instance network info cache for port 1a00fbed-0a5c-49d1-800a-238f198d6411. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.network.neutron [req-d9f2519c-d643-45b2-8425-ea51d495c6e8 req-2a9f9038-66c7-48e7-a670-9d2732227c34 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating instance_info_cache with network_info: [{"id": "1a00fbed-0a5c-49d1-800a-238f198d6411", "address": "fa:16:3e:92:8e:d3", "network": {"id": "cd2a0e0a-d404-4f81-9a3c-783f8a102521", "bridge": "br-int", "label": "tempest-TestShelveInstance-827273717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc9d12d3f5942cc978d1b3636c29335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a00fbed-0a", "ovs_interfaceid": "1a00fbed-0a5c-49d1-800a-238f198d6411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4951c4da-1f35-4082-b308-73dcbc49650a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:00:00 user nova-compute[70914]: No targets found.
Jul 27 14:00:00 user nova-compute[70914]: iSNS:
Jul 27 14:00:00 user nova-compute[70914]: No targets found.
Jul 27 14:00:00 user nova-compute[70914]: STATIC:
Jul 27 14:00:00 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283
Jul 27 14:00:00 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:00:00 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:00:00 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0
Jul 27 14:00:00 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:00:00 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:00:00 user nova-compute[70914]: FIRMWARE:
Jul 27 14:00:00 user nova-compute[70914]: No targets found.
Jul 27 14:00:00 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:00:00 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:00:00 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d9f2519c-d643-45b2-8425-ea51d495c6e8 req-2a9f9038-66c7-48e7-a670-9d2732227c34 service nova] Releasing lock "refresh_cache-e595326a-2178-48d1-ba18-a703a76c23b9" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[122d4db1-e010-4c50-abc8-628a0b08490e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a163af45-5c54-424c-a997-8afd334b3da0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 14:00:00 user nova-compute[70914]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 14:00:00 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 14:00:00 user nova-compute[70914]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 (non-flash)
Jul 27 14:00:00 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf86d6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0'): ({'sde'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Removing single pathed devices sde {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[65779430-027f-42bd-a3ad-09e7ad40948e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a284d-8538-44ea-99c2-8a1c0e3fcba0]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Flushing IO for device /dev/sde {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f72261-7274-4f9c-bb2b-a02c8a957589]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2430da48-9d95-4e5b-92e6-8bc54b0946eb]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] SCSI volumes sde have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcbe6d5-627d-48fa-8fde-df213f570ffa]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6f7fe5-cc51-41df-a93c-176f4900b0a0]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260]
Jul 27 14:00:00 user nova-compute[70914]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0, portal: 172.16.0.220,3260] successful.
Jul 27 14:00:00 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389ab7c2-1b59-4a14-955a-96eeb8f764b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f16761-87d8-4dd9-92a4-f7510793bc90]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] <== disconnect_volume: return (420ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:00:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Deleting instance files /opt/stack/data/nova/instances/e595326a-2178-48d1-ba18-a703a76c23b9_del
Jul 27 14:00:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Deletion of /opt/stack/data/nova/instances/e595326a-2178-48d1-ba18-a703a76c23b9_del complete
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:00 user nova-compute[70914]: INFO nova.compute.manager [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Took 1.35 seconds to destroy the instance on the hypervisor.
Jul 27 14:00:00 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:00:00 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:00:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:00:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8382MB free_disk=25.323001861572266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Acquiring lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Acquiring lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:01 user nova-compute[70914]: INFO nova.compute.manager [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Terminating instance
Jul 27 14:00:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance b5734110-eb9c-4ba8-af64-351e5c8b59ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0e2d383b-d56a-436f-89d8-7b3ed649f43f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8c04e796-5fed-4986-bd21-202b7bc843be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e595326a-2178-48d1-ba18-a703a76c23b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:01 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-980b731c-8b4c-4588-9a03-67e185ee6ef0 req-9d2c8c18-0c2d-45b4-9b8b-ada093188327 service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Received event network-vif-unplugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-980b731c-8b4c-4588-9a03-67e185ee6ef0 req-9d2c8c18-0c2d-45b4-9b8b-ada093188327 service nova] Acquiring lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-980b731c-8b4c-4588-9a03-67e185ee6ef0 req-9d2c8c18-0c2d-45b4-9b8b-ada093188327 service nova] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-980b731c-8b4c-4588-9a03-67e185ee6ef0 req-9d2c8c18-0c2d-45b4-9b8b-ada093188327 service nova] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-980b731c-8b4c-4588-9a03-67e185ee6ef0 req-9d2c8c18-0c2d-45b4-9b8b-ada093188327 service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] No waiting events found dispatching network-vif-unplugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-980b731c-8b4c-4588-9a03-67e185ee6ef0 req-9d2c8c18-0c2d-45b4-9b8b-ada093188327 service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Received event network-vif-unplugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:00:02 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Took 1.06 seconds to deallocate network for instance.
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-f191f9e2-f2f3-4d81-b393-564c3ad47ccc req-26e3103a-11a5-4c75-b53b-ca9088aae5d6 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f191f9e2-f2f3-4d81-b393-564c3ad47ccc req-26e3103a-11a5-4c75-b53b-ca9088aae5d6 service nova] Acquiring lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f191f9e2-f2f3-4d81-b393-564c3ad47ccc req-26e3103a-11a5-4c75-b53b-ca9088aae5d6 service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f191f9e2-f2f3-4d81-b393-564c3ad47ccc req-26e3103a-11a5-4c75-b53b-ca9088aae5d6 service nova] Lock "e595326a-2178-48d1-ba18-a703a76c23b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-f191f9e2-f2f3-4d81-b393-564c3ad47ccc req-26e3103a-11a5-4c75-b53b-ca9088aae5d6 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] No waiting events found dispatching network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:00:02 user nova-compute[70914]: WARNING nova.compute.manager [req-f191f9e2-f2f3-4d81-b393-564c3ad47ccc req-26e3103a-11a5-4c75-b53b-ca9088aae5d6 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received unexpected event network-vif-plugged-1a00fbed-0a5c-49d1-800a-238f198d6411 for instance with vm_state active and task_state deleting.
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.compute.manager [req-f191f9e2-f2f3-4d81-b393-564c3ad47ccc req-26e3103a-11a5-4c75-b53b-ca9088aae5d6 service nova] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Received event network-vif-deleted-1a00fbed-0a5c-49d1-800a-238f198d6411 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Instance destroyed successfully.
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.objects.instance [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lazy-loading 'resources' on Instance uuid 0e2d383b-d56a-436f-89d8-7b3ed649f43f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-936014513',display_name='tempest-VolumesActionsTest-instance-936014513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-936014513',id=41,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:58:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb04ba9df9d34da7879efc6d5ce31159',ramdisk_id='',reservation_id='r-ayr24pth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1210862213',owner_user_name='tempest-VolumesActionsTest-1210862213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:58:08Z,user_data=None,user_id='06a784798e9d4481baf69e090e6f2add',uuid=0e2d383b-d56a-436f-89d8-7b3ed649f43f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "address": "fa:16:3e:db:91:ee", "network": {"id": "93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1059486418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb04ba9df9d34da7879efc6d5ce31159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e64c413-54", "ovs_interfaceid": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Converting VIF {"id": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "address": "fa:16:3e:db:91:ee", "network": {"id": "93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1059486418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb04ba9df9d34da7879efc6d5ce31159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e64c413-54", "ovs_interfaceid": "2e64c413-542f-4225-a5ff-6dfdf651ff7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e64c413-542f-4225-a5ff-6dfdf651ff7a,network=Network(93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e64c413-54') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG os_vif [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e64c413-542f-4225-a5ff-6dfdf651ff7a,network=Network(93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e64c413-54') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e64c413-54, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:00:02 user nova-compute[70914]: INFO os_vif [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e64c413-542f-4225-a5ff-6dfdf651ff7a,network=Network(93e69c85-bbb3-4ec6-bcb1-7d3bc64c5ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e64c413-54')
Jul 27 14:00:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Deleting instance files /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f_del
Jul 27 14:00:02 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Deletion of /opt/stack/data/nova/instances/0e2d383b-d56a-436f-89d8-7b3ed649f43f_del complete
Jul 27 14:00:02 user nova-compute[70914]: INFO nova.compute.manager [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 14:00:02 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:00:02 user nova-compute[70914]: INFO nova.compute.manager [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Took 0.80 seconds to detach 1 volumes for instance.
Jul 27 14:00:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Deleting volume: 389ab7c2-1b59-4a14-955a-96eeb8f764b0 {{(pid=70914) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:00:03 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Took 0.57 seconds to deallocate network for instance.
Jul 27 14:00:03 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.024s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:03 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Deleted allocations for instance e595326a-2178-48d1-ba18-a703a76c23b9
Jul 27 14:00:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8a5da239-e5a9-40b1-bf68-4819f2381505 tempest-TestShelveInstance-1359726663 tempest-TestShelveInstance-1359726663-project-member] Lock "e595326a-2178-48d1-ba18-a703a76c23b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.763s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:00:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:03 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Deleted allocations for instance 0e2d383b-d56a-436f-89d8-7b3ed649f43f
Jul 27 14:00:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-dc6ad24c-6ff4-40ec-8b16-62c7af968ead tempest-VolumesActionsTest-1210862213 tempest-VolumesActionsTest-1210862213-project-member] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.854s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a8bddfe3-c440-4d76-af67-873601939de9 req-6f55664f-5631-40b1-a57a-09bd822944bb service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Received event network-vif-plugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a8bddfe3-c440-4d76-af67-873601939de9 req-6f55664f-5631-40b1-a57a-09bd822944bb service nova] Acquiring lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a8bddfe3-c440-4d76-af67-873601939de9 req-6f55664f-5631-40b1-a57a-09bd822944bb service nova] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a8bddfe3-c440-4d76-af67-873601939de9 req-6f55664f-5631-40b1-a57a-09bd822944bb service nova] Lock "0e2d383b-d56a-436f-89d8-7b3ed649f43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-a8bddfe3-c440-4d76-af67-873601939de9 req-6f55664f-5631-40b1-a57a-09bd822944bb service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] No waiting events found dispatching network-vif-plugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:00:04 user nova-compute[70914]: WARNING nova.compute.manager [req-a8bddfe3-c440-4d76-af67-873601939de9 req-6f55664f-5631-40b1-a57a-09bd822944bb service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Received unexpected event network-vif-plugged-2e64c413-542f-4225-a5ff-6dfdf651ff7a for instance with vm_state deleted and task_state None.
Jul 27 14:00:04 user nova-compute[70914]: DEBUG nova.compute.manager [req-69901417-b614-4891-83c3-cad9fa16711c req-037e3506-419e-45f2-838d-35a192c78614 service nova] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Received event network-vif-deleted-2e64c413-542f-4225-a5ff-6dfdf651ff7a {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:00:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 14:00:06 user nova-compute[70914]: INFO nova.compute.claims [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Claim successful on node user
Jul 27 14:00:06 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 14:00:06 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 14:00:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG nova.network.neutron [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 14:00:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 14:00:06 user nova-compute[70914]: INFO nova.virt.block_device [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Booting with volume snapshot ac43e4da-d746-4f0f-9634-ee16148d66bf at /dev/vda
Jul 27 14:00:06 user nova-compute[70914]: DEBUG nova.policy [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6161b1cf5fb4d08a8cbd36a93b8400c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ac071233d44fbb62e558725f63ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 14:00:07 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466392.3691657, 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:00:07 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] VM Stopped (Lifecycle Event)
Jul 27 14:00:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-79a60a3a-9542-4ea9-86b1-e9793701824a None None] [instance: 8a2674b5-adaf-4195-bbce-9d48fa1fa4e6] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:00:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Successfully created port: eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 14:00:08 user nova-compute[70914]: DEBUG nova.network.neutron [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Successfully updated port: eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 14:00:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "refresh_cache-475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:00:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquired lock "refresh_cache-475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:00:08 user nova-compute[70914]: DEBUG nova.network.neutron [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 14:00:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-40f4c47c-82b6-4e7d-8d82-427e6e14247f req-f368fc16-d010-4e77-9915-b8ec9fd75d9b service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received event network-changed-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-40f4c47c-82b6-4e7d-8d82-427e6e14247f req-f368fc16-d010-4e77-9915-b8ec9fd75d9b service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Refreshing instance network info cache due to event network-changed-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:00:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-40f4c47c-82b6-4e7d-8d82-427e6e14247f req-f368fc16-d010-4e77-9915-b8ec9fd75d9b service nova] Acquiring lock "refresh_cache-475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:00:08 user nova-compute[70914]: DEBUG nova.network.neutron [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 14:00:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Updating instance_info_cache with network_info: [{"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:00:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Releasing lock "refresh_cache-475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:00:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Instance network_info: |[{"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 14:00:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-40f4c47c-82b6-4e7d-8d82-427e6e14247f req-f368fc16-d010-4e77-9915-b8ec9fd75d9b service nova] Acquired lock "refresh_cache-475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:00:09 user nova-compute[70914]: DEBUG nova.network.neutron [req-40f4c47c-82b6-4e7d-8d82-427e6e14247f req-f368fc16-d010-4e77-9915-b8ec9fd75d9b service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Refreshing network info cache for port eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:00:09 user nova-compute[70914]: DEBUG nova.network.neutron [req-40f4c47c-82b6-4e7d-8d82-427e6e14247f req-f368fc16-d010-4e77-9915-b8ec9fd75d9b service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Updated VIF entry in instance network info cache for port eccaaf5c-7ece-42d7-b9c1-57d85c5526ff. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:00:09 user nova-compute[70914]: DEBUG nova.network.neutron [req-40f4c47c-82b6-4e7d-8d82-427e6e14247f req-f368fc16-d010-4e77-9915-b8ec9fd75d9b service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Updating instance_info_cache with network_info: [{"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:00:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-40f4c47c-82b6-4e7d-8d82-427e6e14247f req-f368fc16-d010-4e77-9915-b8ec9fd75d9b service nova] Releasing lock "refresh_cache-475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG os_brick.utils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce329c29-6331-4746-8ae5-80a63b663d93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacd404e-bc81-4cb1-8fe5-1daf84e7cf6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd075b3-da9e-42d7-9221-4a3cd76cd07b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eb3973-c6f3-4770-80bb-84de81d305e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:00:12 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 14:00:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d561e36-6a9b-478f-90ab-cbd936d35bce]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG os_brick.utils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:00:12 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Updating existing volume attachment record: db255b99-ca3f-4fca-afa7-6113ee2f2075 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 14:00:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:15 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466400.388043, e595326a-2178-48d1-ba18-a703a76c23b9 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:00:15 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] VM Stopped (Lifecycle Event)
Jul 27 14:00:15 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0dc71734-e1b0-4a92-aa37-a945db5f41a2 None None] [instance: e595326a-2178-48d1-ba18-a703a76c23b9] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:00:17 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466402.477891, 0e2d383b-d56a-436f-89d8-7b3ed649f43f => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:00:17 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] VM Stopped (Lifecycle Event)
Jul 27 14:00:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cbcf6cfa-5947-4928-a3fd-95da3402e8e0 None None] [instance: 0e2d383b-d56a-436f-89d8-7b3ed649f43f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:00:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 14:00:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Creating image(s)
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Ensure instance console log exists: /opt/stack/data/nova/instances/475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Start _get_guest_xml network_info=[{"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-27T13:59:59Z,direct_url=<?>,disk_format='qcow2',id=56129bb2-aec6-44b6-80f6-d4e172e18097,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-734260217',owner='c73ac071233d44fbb62e558725f63ef8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-27T14:00:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'db255b99-ca3f-4fca-afa7-6113ee2f2075', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVobrdGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7', 'attached_at': '', 'detached_at': '', 'volume_id': '70c4ce14-abc1-490a-91a7-069311061c86', 'serial': '70c4ce14-abc1-490a-91a7-069311061c86'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 14:00:19 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:00:19 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-27T13:59:59Z,direct_url=<?>,disk_format='qcow2',id=56129bb2-aec6-44b6-80f6-d4e172e18097,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-734260217',owner='c73ac071233d44fbb62e558725f63ef8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-27T14:00:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVobrdGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:00:19 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:00:19 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:00:19 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2759ac8f-d19d-4d21-ae9b-46eb7e7a1356]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 14:00:19 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0f0ad1-ad62-4fa8-ae41-c376658ef34a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86] added
Jul 27 14:00:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47ff24c-d4db-4c4d-a0dc-96c537977a4c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[74182114-d2fe-40bd-aa03-eb12c31997e8]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xVobrdGq {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xVobrdGq" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb16b803-be80-4a63-ae59-c7dd91bb28c6]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xVobrdGq'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b3747-a404-482b-a3d7-b380972185ef]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3190ca7-08f2-49e1-9a9b-5d92542a8cef]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 14:00:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 14:00:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0643a71-2fd0-45de-85ae-aa00046960e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86, portal: 172.16.0.220,3260]
Jul 27 14:00:19 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86, portal: 172.16.0.220,3260] successful.
Jul 27 14:00:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[961cbf64-a41f-4c2a-ab0d-1457e947eb4f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6de57d1-289e-4392-b91d-0e9b6710124f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 14:00:19 user nova-compute[70914]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 (non-flash)
Jul 27 14:00:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 14:00:19 user nova-compute[70914]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 (non-flash)
Jul 27 14:00:19 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[776f4809-8296-40ba-a9d7-310b08bcf3f1]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:00:19 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVobrdGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23234356638306533', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234356638306533', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-634105337',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-634105337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-634105337',id=43,image_ref='56129bb2-aec6-44b6-80f6-d4e172e18097',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BOCJvJG93unNBqaVgn6ysj/0WjA4JH08pySLQaZBsoc93EoKC8/aUJR67wGvpImncjQYWeD9FaIZ9q/wZ0jSTi05nE2zowOQyVhBAfrlVdxnSiLqJrSTL/mLEJyNzfA==',key_name='tempest-keypair-919152255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-l6pj3tvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1923193575',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=eccaaf5c-7ece-42d7-b9c1-57d85c5526ff,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccaaf5c-7e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'pci_devices' on Instance uuid 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] End _get_guest_xml xml=<domain type="kvm">
Jul 27 14:00:20 user nova-compute[70914]:   <uuid>475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7</uuid>
Jul 27 14:00:20 user nova-compute[70914]:   <name>instance-0000002b</name>
Jul 27 14:00:20 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 14:00:20 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 14:00:20 user nova-compute[70914]:   <metadata>
Jul 27 14:00:20 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 14:00:20 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 14:00:20 user nova-compute[70914]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-634105337</nova:name>
Jul 27 14:00:20 user nova-compute[70914]:       <nova:creationTime>2023-07-27 14:00:19</nova:creationTime>
Jul 27 14:00:20 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 14:00:20 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 14:00:20 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 14:00:20 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 14:00:20 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 14:00:20 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 14:00:20 user nova-compute[70914]:       </nova:flavor>
Jul 27 14:00:20 user nova-compute[70914]:       <nova:owner>
Jul 27 14:00:20 user nova-compute[70914]:         <nova:user uuid="b6161b1cf5fb4d08a8cbd36a93b8400c">tempest-TestVolumeBootPattern-1923193575-project-member</nova:user>
Jul 27 14:00:20 user nova-compute[70914]:         <nova:project uuid="c73ac071233d44fbb62e558725f63ef8">tempest-TestVolumeBootPattern-1923193575</nova:project>
Jul 27 14:00:20 user nova-compute[70914]:       </nova:owner>
Jul 27 14:00:20 user nova-compute[70914]:       <nova:root type="image" uuid="56129bb2-aec6-44b6-80f6-d4e172e18097"/>
Jul 27 14:00:20 user nova-compute[70914]:       <nova:ports>
Jul 27 14:00:20 user nova-compute[70914]:         <nova:port uuid="eccaaf5c-7ece-42d7-b9c1-57d85c5526ff">
Jul 27 14:00:20 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 14:00:20 user nova-compute[70914]:         </nova:port>
Jul 27 14:00:20 user nova-compute[70914]:       </nova:ports>
Jul 27 14:00:20 user nova-compute[70914]:     </nova:instance>
Jul 27 14:00:20 user nova-compute[70914]:   </metadata>
Jul 27 14:00:20 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 14:00:20 user nova-compute[70914]:     <system>
Jul 27 14:00:20 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 14:00:20 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 14:00:20 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 14:00:20 user nova-compute[70914]:       <entry name="serial">475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7</entry>
Jul 27 14:00:20 user nova-compute[70914]:       <entry name="uuid">475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7</entry>
Jul 27 14:00:20 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 14:00:20 user nova-compute[70914]:     </system>
Jul 27 14:00:20 user nova-compute[70914]:   </sysinfo>
Jul 27 14:00:20 user nova-compute[70914]:   <os>
Jul 27 14:00:20 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 14:00:20 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 14:00:20 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 14:00:20 user nova-compute[70914]:   </os>
Jul 27 14:00:20 user nova-compute[70914]:   <features>
Jul 27 14:00:20 user nova-compute[70914]:     <acpi/>
Jul 27 14:00:20 user nova-compute[70914]:     <apic/>
Jul 27 14:00:20 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 14:00:20 user nova-compute[70914]:   </features>
Jul 27 14:00:20 user nova-compute[70914]:   <clock offset="utc">
Jul 27 14:00:20 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 14:00:20 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 14:00:20 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 14:00:20 user nova-compute[70914]:   </clock>
Jul 27 14:00:20 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 14:00:20 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 14:00:20 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 14:00:20 user nova-compute[70914]:   </cpu>
Jul 27 14:00:20 user nova-compute[70914]:   <devices>
Jul 27 14:00:20 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 14:00:20 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:00:20 user nova-compute[70914]:       <source dev="/dev/sdb"/>
Jul 27 14:00:20 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 14:00:20 user nova-compute[70914]:       <serial>70c4ce14-abc1-490a-91a7-069311061c86</serial>
Jul 27 14:00:20 user nova-compute[70914]:     </disk>
Jul 27 14:00:20 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 14:00:20 user nova-compute[70914]:       <mac address="fa:16:3e:95:6e:b8"/>
Jul 27 14:00:20 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:00:20 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 14:00:20 user nova-compute[70914]:       <target dev="tapeccaaf5c-7e"/>
Jul 27 14:00:20 user nova-compute[70914]:     </interface>
Jul 27 14:00:20 user nova-compute[70914]:     <serial type="pty">
Jul 27 14:00:20 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7/console.log" append="off"/>
Jul 27 14:00:20 user nova-compute[70914]:     </serial>
Jul 27 14:00:20 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 14:00:20 user nova-compute[70914]:     <video>
Jul 27 14:00:20 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:00:20 user nova-compute[70914]:     </video>
Jul 27 14:00:20 user nova-compute[70914]:     <rng model="virtio">
Jul 27 14:00:20 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 14:00:20 user nova-compute[70914]:     </rng>
Jul 27 14:00:20 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 14:00:20 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 14:00:20 user nova-compute[70914]:       <stats period="10"/>
Jul 27 14:00:20 user nova-compute[70914]:     </memballoon>
Jul 27 14:00:20 user nova-compute[70914]:   </devices>
Jul 27 14:00:20 user nova-compute[70914]: </domain>
Jul 27 14:00:20 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-634105337',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-634105337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-634105337',id=43,image_ref='56129bb2-aec6-44b6-80f6-d4e172e18097',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BOCJvJG93unNBqaVgn6ysj/0WjA4JH08pySLQaZBsoc93EoKC8/aUJR67wGvpImncjQYWeD9FaIZ9q/wZ0jSTi05nE2zowOQyVhBAfrlVdxnSiLqJrSTL/mLEJyNzfA==',key_name='tempest-keypair-919152255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-l6pj3tvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1923193575',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=eccaaf5c-7ece-42d7-b9c1-57d85c5526ff,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccaaf5c-7e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG os_vif [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=eccaaf5c-7ece-42d7-b9c1-57d85c5526ff,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccaaf5c-7e') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeccaaf5c-7e, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeccaaf5c-7e, col_values=(('external_ids', {'iface-id': 'eccaaf5c-7ece-42d7-b9c1-57d85c5526ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:6e:b8', 'vm-uuid': '475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:00:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:00:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:21 user nova-compute[70914]: INFO os_vif [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=eccaaf5c-7ece-42d7-b9c1-57d85c5526ff,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccaaf5c-7e')
Jul 27 14:00:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:00:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No VIF found with MAC fa:16:3e:95:6e:b8, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:00:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:21 user nova-compute[70914]: INFO nova.compute.manager [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Terminating instance
Jul 27 14:00:21 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-895964df-6c8e-4b07-9fc7-ac13ca95976a req-97f1465f-09f2-45f9-961f-5728558d76fd service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received event network-vif-unplugged-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-895964df-6c8e-4b07-9fc7-ac13ca95976a req-97f1465f-09f2-45f9-961f-5728558d76fd service nova] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-895964df-6c8e-4b07-9fc7-ac13ca95976a req-97f1465f-09f2-45f9-961f-5728558d76fd service nova] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-895964df-6c8e-4b07-9fc7-ac13ca95976a req-97f1465f-09f2-45f9-961f-5728558d76fd service nova] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-895964df-6c8e-4b07-9fc7-ac13ca95976a req-97f1465f-09f2-45f9-961f-5728558d76fd service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] No waiting events found dispatching network-vif-unplugged-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-895964df-6c8e-4b07-9fc7-ac13ca95976a req-97f1465f-09f2-45f9-961f-5728558d76fd service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received event network-vif-unplugged-509f9e28-206a-4400-9e8f-a5895875961b for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-f02969f6-d8a4-4e11-8b06-b9103eedc1d2 req-5ff55964-4445-492f-a17f-bff650d1256f service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received event network-vif-plugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f02969f6-d8a4-4e11-8b06-b9103eedc1d2 req-5ff55964-4445-492f-a17f-bff650d1256f service nova] Acquiring lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f02969f6-d8a4-4e11-8b06-b9103eedc1d2 req-5ff55964-4445-492f-a17f-bff650d1256f service nova] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f02969f6-d8a4-4e11-8b06-b9103eedc1d2 req-5ff55964-4445-492f-a17f-bff650d1256f service nova] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG nova.compute.manager [req-f02969f6-d8a4-4e11-8b06-b9103eedc1d2 req-5ff55964-4445-492f-a17f-bff650d1256f service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] No waiting events found dispatching network-vif-plugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:00:22 user nova-compute[70914]: WARNING nova.compute.manager [req-f02969f6-d8a4-4e11-8b06-b9103eedc1d2 req-5ff55964-4445-492f-a17f-bff650d1256f service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received unexpected event network-vif-plugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff for instance with vm_state building and task_state spawning.
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Instance destroyed successfully.
Jul 27 14:00:22 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'resources' on Instance uuid b5734110-eb9c-4ba8-af64-351e5c8b59ef {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:54:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1498292459',display_name='tempest-AttachVolumeNegativeTest-server-1498292459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1498292459',id=38,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALvjFB0ClV4UcUlMvQpPWX/FHv8pybq83fkhfpkUqGOT6puiQ5tGxi6AIuWXcfRrYmbmAJhEDOBLmgXP5LENCF/FTrY199UEe6kQUZjWFeBsZcvUbrHpKIyGfBXRl/eCw==',key_name='tempest-keypair-1429246869',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-sqse7ikc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=b5734110-eb9c-4ba8-af64-351e5c8b59ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "509f9e28-206a-4400-9e8f-a5895875961b", "address": "fa:16:3e:5a:de:65", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509f9e28-20", "ovs_interfaceid": "509f9e28-206a-4400-9e8f-a5895875961b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:de:65,bridge_name='br-int',has_traffic_filtering=True,id=509f9e28-206a-4400-9e8f-a5895875961b,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509f9e28-20') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG os_vif [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:de:65,bridge_name='br-int',has_traffic_filtering=True,id=509f9e28-206a-4400-9e8f-a5895875961b,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509f9e28-20') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap509f9e28-20, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:00:22 user nova-compute[70914]: INFO os_vif [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:de:65,bridge_name='br-int',has_traffic_filtering=True,id=509f9e28-206a-4400-9e8f-a5895875961b,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509f9e28-20')
Jul 27 14:00:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Deleting instance files /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef_del
Jul 27 14:00:22 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Deletion of /opt/stack/data/nova/instances/b5734110-eb9c-4ba8-af64-351e5c8b59ef_del complete
Jul 27 14:00:23 user nova-compute[70914]: INFO nova.compute.manager [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Took 1.08 seconds to destroy the instance on the hypervisor.
Jul 27 14:00:23 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:00:23 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:00:23 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:00:23 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:00:23 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Took 0.86 seconds to deallocate network for instance.
Jul 27 14:00:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a62dd6d-4346-4ca7-89a4-7e43328b7185 req-4f0a12c7-56d0-4a25-9282-d0118d06f0e1 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received event network-vif-plugged-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a62dd6d-4346-4ca7-89a4-7e43328b7185 req-4f0a12c7-56d0-4a25-9282-d0118d06f0e1 service nova] Acquiring lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a62dd6d-4346-4ca7-89a4-7e43328b7185 req-4f0a12c7-56d0-4a25-9282-d0118d06f0e1 service nova] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a62dd6d-4346-4ca7-89a4-7e43328b7185 req-4f0a12c7-56d0-4a25-9282-d0118d06f0e1 service nova] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a62dd6d-4346-4ca7-89a4-7e43328b7185 req-4f0a12c7-56d0-4a25-9282-d0118d06f0e1 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] No waiting events found dispatching network-vif-plugged-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:00:24 user nova-compute[70914]: WARNING nova.compute.manager [req-2a62dd6d-4346-4ca7-89a4-7e43328b7185 req-4f0a12c7-56d0-4a25-9282-d0118d06f0e1 service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received unexpected event network-vif-plugged-509f9e28-206a-4400-9e8f-a5895875961b for instance with vm_state deleted and task_state None.
Jul 27 14:00:24 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Deleted allocations for instance b5734110-eb9c-4ba8-af64-351e5c8b59ef
Jul 27 14:00:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5f4f6217-f74b-4627-8ce7-e01e2bcf8030 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "b5734110-eb9c-4ba8-af64-351e5c8b59ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.519s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-65c9ad6c-9f0a-4d60-946e-4272462da39a req-a260026c-bfaf-4733-8d70-4b9c8db0b30f service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received event network-vif-plugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-65c9ad6c-9f0a-4d60-946e-4272462da39a req-a260026c-bfaf-4733-8d70-4b9c8db0b30f service nova] Acquiring lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-65c9ad6c-9f0a-4d60-946e-4272462da39a req-a260026c-bfaf-4733-8d70-4b9c8db0b30f service nova] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-65c9ad6c-9f0a-4d60-946e-4272462da39a req-a260026c-bfaf-4733-8d70-4b9c8db0b30f service nova] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-65c9ad6c-9f0a-4d60-946e-4272462da39a req-a260026c-bfaf-4733-8d70-4b9c8db0b30f service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] No waiting events found dispatching network-vif-plugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:00:24 user nova-compute[70914]: WARNING nova.compute.manager [req-65c9ad6c-9f0a-4d60-946e-4272462da39a req-a260026c-bfaf-4733-8d70-4b9c8db0b30f service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received unexpected event network-vif-plugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff for instance with vm_state building and task_state spawning.
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-65c9ad6c-9f0a-4d60-946e-4272462da39a req-a260026c-bfaf-4733-8d70-4b9c8db0b30f service nova] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Received event network-vif-deleted-509f9e28-206a-4400-9e8f-a5895875961b {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466424.6938403, 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:00:24 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] VM Resumed (Lifecycle Event)
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 14:00:24 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Instance spawned successfully.
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:00:24 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466424.696885, 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:00:24 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] VM Started (Lifecycle Event)
Jul 27 14:00:24 user nova-compute[70914]: INFO nova.compute.manager [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Took 5.24 seconds to spawn the instance on the hypervisor.
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:00:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:00:24 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:00:24 user nova-compute[70914]: INFO nova.compute.manager [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Took 18.32 seconds to build instance.
Jul 27 14:00:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a9a11d3-39ec-45a9-a343-1b7d9b7c3bf4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.420s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:37 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466422.9477959, b5734110-eb9c-4ba8-af64-351e5c8b59ef => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:00:37 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] VM Stopped (Lifecycle Event)
Jul 27 14:00:37 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1771b401-073d-486a-a562-fb04bdf7061e None None] [instance: b5734110-eb9c-4ba8-af64-351e5c8b59ef] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:00:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:00:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:00:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:00:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:00:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:00:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:45 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:55 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:00:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:00:58 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:00:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:00:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:00:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:00:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:00:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:00:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:00:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:01:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:01:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:01:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8471MB free_disk=25.375144958496094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:01:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8c04e796-5fed-4986-bd21-202b7bc843be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:01:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:01:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:01:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:01:00 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:01:00 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:01:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:01:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:01:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:01:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:01:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:01:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:01:04 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:01:04 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 14:01:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:01:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:01:04 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:01:04 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 8c04e796-5fed-4986-bd21-202b7bc843be {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:01:05 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Updating instance_info_cache with network_info: [{"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:01:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-8c04e796-5fed-4986-bd21-202b7bc843be" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:01:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:01:05 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:01:06 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:01:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:07 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:01:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 14:01:17 user nova-compute[70914]: INFO nova.compute.claims [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Claim successful on node user
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.277s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 14:01:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 14:01:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Creating image(s)
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "/opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "/opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG nova.policy [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39c9278ea5d24d2a9182c20bcb32febb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8032e7912884d3bb9a66632f95137ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.153s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk 1073741824" returned: 0 in 0.069s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.165s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Cannot resize image /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'migration_context' on Instance uuid aa0c73e8-873a-4ed1-9fda-373cd23a98e8 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Ensure instance console log exists: /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Successfully created port: 957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:18 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 14:01:18 user nova-compute[70914]: INFO nova.compute.claims [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Claim successful on node user
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 14:01:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.policy [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '643c0433178c46d084bcf154c766aa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dfe41ebcf84a7597ea5721759b068f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 14:01:19 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Creating image(s)
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "/opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "/opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "/opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.network.neutron [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Successfully updated port: 957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.197s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquired lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.network.neutron [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-acf5a657-73b7-4487-87de-7c89faabde59 req-4feea8f5-b6ab-4e9b-9df4-3110f384e616 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received event network-changed-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-acf5a657-73b7-4487-87de-7c89faabde59 req-4feea8f5-b6ab-4e9b-9df4-3110f384e616 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Refreshing instance network info cache due to event network-changed-957cfbc5-b8cd-4780-a0dc-634a3e55d46f. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-acf5a657-73b7-4487-87de-7c89faabde59 req-4feea8f5-b6ab-4e9b-9df4-3110f384e616 service nova] Acquiring lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG nova.network.neutron [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.172s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk 1073741824" returned: 0 in 0.063s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:19 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.network.neutron [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Updating instance_info_cache with network_info: [{"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Cannot resize image /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.objects.instance [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'migration_context' on Instance uuid 60d35122-55c4-458e-bf51-db6d2a87b1d1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Ensure instance console log exists: /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Successfully created port: 19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Releasing lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Instance network_info: |[{"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-acf5a657-73b7-4487-87de-7c89faabde59 req-4feea8f5-b6ab-4e9b-9df4-3110f384e616 service nova] Acquired lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-acf5a657-73b7-4487-87de-7c89faabde59 req-4feea8f5-b6ab-4e9b-9df4-3110f384e616 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Refreshing network info cache for port 957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Start _get_guest_xml network_info=[{"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 14:01:20 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:01:20 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-875178706',display_name='tempest-AttachVolumeNegativeTest-server-875178706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-875178706',id=44,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzrXHxPx9tH/CBro2HYB1z+5GjQdqGIdKoaVzz3mPWnJxRUxMrTeJvBeOHG55GN3H1/Opp9/K/2xgr7k7Tzx1HaSG1Gy2OvZigWZLw2uNw8ft4vsJDhWOIYzrQgJDH7Aw==',key_name='tempest-keypair-889281859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-8cjagl1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:01:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=aa0c73e8-873a-4ed1-9fda-373cd23a98e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:65:81,bridge_name='br-int',has_traffic_filtering=True,id=957cfbc5-b8cd-4780-a0dc-634a3e55d46f,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957cfbc5-b8') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'pci_devices' on Instance uuid aa0c73e8-873a-4ed1-9fda-373cd23a98e8 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] End _get_guest_xml xml=<domain type="kvm">
Jul 27 14:01:20 user nova-compute[70914]:   <uuid>aa0c73e8-873a-4ed1-9fda-373cd23a98e8</uuid>
Jul 27 14:01:20 user nova-compute[70914]:   <name>instance-0000002c</name>
Jul 27 14:01:20 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 14:01:20 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 14:01:20 user nova-compute[70914]:   <metadata>
Jul 27 14:01:20 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 14:01:20 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 14:01:20 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeNegativeTest-server-875178706</nova:name>
Jul 27 14:01:20 user nova-compute[70914]:       <nova:creationTime>2023-07-27 14:01:20</nova:creationTime>
Jul 27 14:01:20 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 14:01:20 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 14:01:20 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 14:01:20 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 14:01:20 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 14:01:20 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 14:01:20 user nova-compute[70914]:       </nova:flavor>
Jul 27 14:01:20 user nova-compute[70914]:       <nova:owner>
Jul 27 14:01:20 user nova-compute[70914]:         <nova:user uuid="39c9278ea5d24d2a9182c20bcb32febb">tempest-AttachVolumeNegativeTest-431364948-project-member</nova:user>
Jul 27 14:01:20 user nova-compute[70914]:         <nova:project uuid="f8032e7912884d3bb9a66632f95137ad">tempest-AttachVolumeNegativeTest-431364948</nova:project>
Jul 27 14:01:20 user nova-compute[70914]:       </nova:owner>
Jul 27 14:01:20 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 14:01:20 user nova-compute[70914]:       <nova:ports>
Jul 27 14:01:20 user nova-compute[70914]:         <nova:port uuid="957cfbc5-b8cd-4780-a0dc-634a3e55d46f">
Jul 27 14:01:20 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 14:01:20 user nova-compute[70914]:         </nova:port>
Jul 27 14:01:20 user nova-compute[70914]:       </nova:ports>
Jul 27 14:01:20 user nova-compute[70914]:     </nova:instance>
Jul 27 14:01:20 user nova-compute[70914]:   </metadata>
Jul 27 14:01:20 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 14:01:20 user nova-compute[70914]:     <system>
Jul 27 14:01:20 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 14:01:20 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 14:01:20 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 14:01:20 user nova-compute[70914]:       <entry name="serial">aa0c73e8-873a-4ed1-9fda-373cd23a98e8</entry>
Jul 27 14:01:20 user nova-compute[70914]:       <entry name="uuid">aa0c73e8-873a-4ed1-9fda-373cd23a98e8</entry>
Jul 27 14:01:20 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 14:01:20 user nova-compute[70914]:     </system>
Jul 27 14:01:20 user nova-compute[70914]:   </sysinfo>
Jul 27 14:01:20 user nova-compute[70914]:   <os>
Jul 27 14:01:20 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 14:01:20 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 14:01:20 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 14:01:20 user nova-compute[70914]:   </os>
Jul 27 14:01:20 user nova-compute[70914]:   <features>
Jul 27 14:01:20 user nova-compute[70914]:     <acpi/>
Jul 27 14:01:20 user nova-compute[70914]:     <apic/>
Jul 27 14:01:20 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 14:01:20 user nova-compute[70914]:   </features>
Jul 27 14:01:20 user nova-compute[70914]:   <clock offset="utc">
Jul 27 14:01:20 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 14:01:20 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 14:01:20 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 14:01:20 user nova-compute[70914]:   </clock>
Jul 27 14:01:20 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 14:01:20 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 14:01:20 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 14:01:20 user nova-compute[70914]:   </cpu>
Jul 27 14:01:20 user nova-compute[70914]:   <devices>
Jul 27 14:01:20 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 14:01:20 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 14:01:20 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk"/>
Jul 27 14:01:20 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 14:01:20 user nova-compute[70914]:     </disk>
Jul 27 14:01:20 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 14:01:20 user nova-compute[70914]:       <mac address="fa:16:3e:26:65:81"/>
Jul 27 14:01:20 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:01:20 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 14:01:20 user nova-compute[70914]:       <target dev="tap957cfbc5-b8"/>
Jul 27 14:01:20 user nova-compute[70914]:     </interface>
Jul 27 14:01:20 user nova-compute[70914]:     <serial type="pty">
Jul 27 14:01:20 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/console.log" append="off"/>
Jul 27 14:01:20 user nova-compute[70914]:     </serial>
Jul 27 14:01:20 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 14:01:20 user nova-compute[70914]:     <video>
Jul 27 14:01:20 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:01:20 user nova-compute[70914]:     </video>
Jul 27 14:01:20 user nova-compute[70914]:     <rng model="virtio">
Jul 27 14:01:20 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 14:01:20 user nova-compute[70914]:     </rng>
Jul 27 14:01:20 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 14:01:20 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 14:01:20 user nova-compute[70914]:       <stats period="10"/>
Jul 27 14:01:20 user nova-compute[70914]:     </memballoon>
Jul 27 14:01:20 user nova-compute[70914]:   </devices>
Jul 27 14:01:20 user nova-compute[70914]: </domain>
Jul 27 14:01:20 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-875178706',display_name='tempest-AttachVolumeNegativeTest-server-875178706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-875178706',id=44,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzrXHxPx9tH/CBro2HYB1z+5GjQdqGIdKoaVzz3mPWnJxRUxMrTeJvBeOHG55GN3H1/Opp9/K/2xgr7k7Tzx1HaSG1Gy2OvZigWZLw2uNw8ft4vsJDhWOIYzrQgJDH7Aw==',key_name='tempest-keypair-889281859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-8cjagl1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:01:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=aa0c73e8-873a-4ed1-9fda-373cd23a98e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:65:81,bridge_name='br-int',has_traffic_filtering=True,id=957cfbc5-b8cd-4780-a0dc-634a3e55d46f,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957cfbc5-b8') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG os_vif [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:65:81,bridge_name='br-int',has_traffic_filtering=True,id=957cfbc5-b8cd-4780-a0dc-634a3e55d46f,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957cfbc5-b8') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap957cfbc5-b8, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap957cfbc5-b8, col_values=(('external_ids', {'iface-id': '957cfbc5-b8cd-4780-a0dc-634a3e55d46f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:65:81', 'vm-uuid': 'aa0c73e8-873a-4ed1-9fda-373cd23a98e8'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:20 user nova-compute[70914]: INFO os_vif [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:65:81,bridge_name='br-int',has_traffic_filtering=True,id=957cfbc5-b8cd-4780-a0dc-634a3e55d46f,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957cfbc5-b8')
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No VIF found with MAC fa:16:3e:26:65:81, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-acf5a657-73b7-4487-87de-7c89faabde59 req-4feea8f5-b6ab-4e9b-9df4-3110f384e616 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Updated VIF entry in instance network info cache for port 957cfbc5-b8cd-4780-a0dc-634a3e55d46f. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG nova.network.neutron [req-acf5a657-73b7-4487-87de-7c89faabde59 req-4feea8f5-b6ab-4e9b-9df4-3110f384e616 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Updating instance_info_cache with network_info: [{"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:01:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-acf5a657-73b7-4487-87de-7c89faabde59 req-4feea8f5-b6ab-4e9b-9df4-3110f384e616 service nova] Releasing lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Successfully updated port: 19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquired lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-23667851-056e-4c01-8e07-b1f1b5aadae5 req-2302deb2-f34d-4a63-85cd-6d020636c6d8 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received event network-changed-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-23667851-056e-4c01-8e07-b1f1b5aadae5 req-2302deb2-f34d-4a63-85cd-6d020636c6d8 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Refreshing instance network info cache due to event network-changed-19753b73-1f3e-4620-832c-3d9ef7827622. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-23667851-056e-4c01-8e07-b1f1b5aadae5 req-2302deb2-f34d-4a63-85cd-6d020636c6d8 service nova] Acquiring lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updating instance_info_cache with network_info: [{"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Releasing lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Instance network_info: |[{"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-23667851-056e-4c01-8e07-b1f1b5aadae5 req-2302deb2-f34d-4a63-85cd-6d020636c6d8 service nova] Acquired lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.neutron [req-23667851-056e-4c01-8e07-b1f1b5aadae5 req-2302deb2-f34d-4a63-85cd-6d020636c6d8 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Refreshing network info cache for port 19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Start _get_guest_xml network_info=[{"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 14:01:21 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:01:21 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-816530875',display_name='tempest-TestStampPattern-server-816530875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-816530875',id=45,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmLBSHyza1ghqnyyQ42csa2OCb7CLlsDqq29Po3ZvJ5ZlfPbjKBzUNAtQpBtn8A2PGxT1NM6sUeoKBKRpDDoEXF0T9Pf9kYEfBvWYc34edA7pq6zvHJD5NDhZdwsPGjdA==',key_name='tempest-TestStampPattern-1764772644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47dfe41ebcf84a7597ea5721759b068f',ramdisk_id='',reservation_id='r-bu20nc8y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1948059244',owner_user_name='tempest-TestStampPattern-1948059244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:01:19Z,user_data=None,user_id='643c0433178c46d084bcf154c766aa36',uuid=60d35122-55c4-458e-bf51-db6d2a87b1d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converting VIF {"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:48:26,bridge_name='br-int',has_traffic_filtering=True,id=19753b73-1f3e-4620-832c-3d9ef7827622,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19753b73-1f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.objects.instance [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'pci_devices' on Instance uuid 60d35122-55c4-458e-bf51-db6d2a87b1d1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] End _get_guest_xml xml=<domain type="kvm">
Jul 27 14:01:21 user nova-compute[70914]:   <uuid>60d35122-55c4-458e-bf51-db6d2a87b1d1</uuid>
Jul 27 14:01:21 user nova-compute[70914]:   <name>instance-0000002d</name>
Jul 27 14:01:21 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 14:01:21 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 14:01:21 user nova-compute[70914]:   <metadata>
Jul 27 14:01:21 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 14:01:21 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 14:01:21 user nova-compute[70914]:       <nova:name>tempest-TestStampPattern-server-816530875</nova:name>
Jul 27 14:01:21 user nova-compute[70914]:       <nova:creationTime>2023-07-27 14:01:21</nova:creationTime>
Jul 27 14:01:21 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 14:01:21 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 14:01:21 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 14:01:21 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 14:01:21 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 14:01:21 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 14:01:21 user nova-compute[70914]:       </nova:flavor>
Jul 27 14:01:21 user nova-compute[70914]:       <nova:owner>
Jul 27 14:01:21 user nova-compute[70914]:         <nova:user uuid="643c0433178c46d084bcf154c766aa36">tempest-TestStampPattern-1948059244-project-member</nova:user>
Jul 27 14:01:21 user nova-compute[70914]:         <nova:project uuid="47dfe41ebcf84a7597ea5721759b068f">tempest-TestStampPattern-1948059244</nova:project>
Jul 27 14:01:21 user nova-compute[70914]:       </nova:owner>
Jul 27 14:01:21 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 14:01:21 user nova-compute[70914]:       <nova:ports>
Jul 27 14:01:21 user nova-compute[70914]:         <nova:port uuid="19753b73-1f3e-4620-832c-3d9ef7827622">
Jul 27 14:01:21 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 14:01:21 user nova-compute[70914]:         </nova:port>
Jul 27 14:01:21 user nova-compute[70914]:       </nova:ports>
Jul 27 14:01:21 user nova-compute[70914]:     </nova:instance>
Jul 27 14:01:21 user nova-compute[70914]:   </metadata>
Jul 27 14:01:21 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 14:01:21 user nova-compute[70914]:     <system>
Jul 27 14:01:21 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 14:01:21 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 14:01:21 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 14:01:21 user nova-compute[70914]:       <entry name="serial">60d35122-55c4-458e-bf51-db6d2a87b1d1</entry>
Jul 27 14:01:21 user nova-compute[70914]:       <entry name="uuid">60d35122-55c4-458e-bf51-db6d2a87b1d1</entry>
Jul 27 14:01:21 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 14:01:21 user nova-compute[70914]:     </system>
Jul 27 14:01:21 user nova-compute[70914]:   </sysinfo>
Jul 27 14:01:21 user nova-compute[70914]:   <os>
Jul 27 14:01:21 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 14:01:21 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 14:01:21 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 14:01:21 user nova-compute[70914]:   </os>
Jul 27 14:01:21 user nova-compute[70914]:   <features>
Jul 27 14:01:21 user nova-compute[70914]:     <acpi/>
Jul 27 14:01:21 user nova-compute[70914]:     <apic/>
Jul 27 14:01:21 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 14:01:21 user nova-compute[70914]:   </features>
Jul 27 14:01:21 user nova-compute[70914]:   <clock offset="utc">
Jul 27 14:01:21 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 14:01:21 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 14:01:21 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 14:01:21 user nova-compute[70914]:   </clock>
Jul 27 14:01:21 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 14:01:21 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 14:01:21 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 14:01:21 user nova-compute[70914]:   </cpu>
Jul 27 14:01:21 user nova-compute[70914]:   <devices>
Jul 27 14:01:21 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 14:01:21 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 14:01:21 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk"/>
Jul 27 14:01:21 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 14:01:21 user nova-compute[70914]:     </disk>
Jul 27 14:01:21 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 14:01:21 user nova-compute[70914]:       <mac address="fa:16:3e:ca:48:26"/>
Jul 27 14:01:21 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:01:21 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 14:01:21 user nova-compute[70914]:       <target dev="tap19753b73-1f"/>
Jul 27 14:01:21 user nova-compute[70914]:     </interface>
Jul 27 14:01:21 user nova-compute[70914]:     <serial type="pty">
Jul 27 14:01:21 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/console.log" append="off"/>
Jul 27 14:01:21 user nova-compute[70914]:     </serial>
Jul 27 14:01:21 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 14:01:21 user nova-compute[70914]:     <video>
Jul 27 14:01:21 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:01:21 user nova-compute[70914]:     </video>
Jul 27 14:01:21 user nova-compute[70914]:     <rng model="virtio">
Jul 27 14:01:21 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 14:01:21 user nova-compute[70914]:     </rng>
Jul 27 14:01:21 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 14:01:21 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 14:01:21 user nova-compute[70914]:       <stats period="10"/>
Jul 27 14:01:21 user nova-compute[70914]:     </memballoon>
Jul 27 14:01:21 user nova-compute[70914]:   </devices>
Jul 27 14:01:21 user nova-compute[70914]: </domain>
Jul 27 14:01:21 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-816530875',display_name='tempest-TestStampPattern-server-816530875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-816530875',id=45,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmLBSHyza1ghqnyyQ42csa2OCb7CLlsDqq29Po3ZvJ5ZlfPbjKBzUNAtQpBtn8A2PGxT1NM6sUeoKBKRpDDoEXF0T9Pf9kYEfBvWYc34edA7pq6zvHJD5NDhZdwsPGjdA==',key_name='tempest-TestStampPattern-1764772644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47dfe41ebcf84a7597ea5721759b068f',ramdisk_id='',reservation_id='r-bu20nc8y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1948059244',owner_user_name='tempest-TestStampPattern-1948059244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:01:19Z,user_data=None,user_id='643c0433178c46d084bcf154c766aa36',uuid=60d35122-55c4-458e-bf51-db6d2a87b1d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converting VIF {"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:48:26,bridge_name='br-int',has_traffic_filtering=True,id=19753b73-1f3e-4620-832c-3d9ef7827622,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19753b73-1f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG os_vif [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:48:26,bridge_name='br-int',has_traffic_filtering=True,id=19753b73-1f3e-4620-832c-3d9ef7827622,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19753b73-1f') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19753b73-1f, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19753b73-1f, col_values=(('external_ids', {'iface-id': '19753b73-1f3e-4620-832c-3d9ef7827622', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:48:26', 'vm-uuid': '60d35122-55c4-458e-bf51-db6d2a87b1d1'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:21 user nova-compute[70914]: INFO os_vif [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:48:26,bridge_name='br-int',has_traffic_filtering=True,id=19753b73-1f3e-4620-832c-3d9ef7827622,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19753b73-1f')
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] No VIF found with MAC fa:16:3e:ca:48:26, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.neutron [req-23667851-056e-4c01-8e07-b1f1b5aadae5 req-2302deb2-f34d-4a63-85cd-6d020636c6d8 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updated VIF entry in instance network info cache for port 19753b73-1f3e-4620-832c-3d9ef7827622. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG nova.network.neutron [req-23667851-056e-4c01-8e07-b1f1b5aadae5 req-2302deb2-f34d-4a63-85cd-6d020636c6d8 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updating instance_info_cache with network_info: [{"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:01:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-23667851-056e-4c01-8e07-b1f1b5aadae5 req-2302deb2-f34d-4a63-85cd-6d020636c6d8 service nova] Releasing lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:01:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received event network-vif-plugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] Acquiring lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] No waiting events found dispatching network-vif-plugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:01:23 user nova-compute[70914]: WARNING nova.compute.manager [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received unexpected event network-vif-plugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f for instance with vm_state building and task_state spawning.
Jul 27 14:01:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received event network-vif-plugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] Acquiring lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] No waiting events found dispatching network-vif-plugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:01:23 user nova-compute[70914]: WARNING nova.compute.manager [req-81864a17-0d5d-4bf9-ab81-5340e16bf65f req-e7190143-c899-4d97-8481-e55f26b6c33a service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received unexpected event network-vif-plugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f for instance with vm_state building and task_state spawning.
Jul 27 14:01:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-e2ffb571-7108-4e4c-a8f0-161470d44f20 req-8e9b2f4d-4305-4d55-9233-5628e1ae637d service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received event network-vif-plugged-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e2ffb571-7108-4e4c-a8f0-161470d44f20 req-8e9b2f4d-4305-4d55-9233-5628e1ae637d service nova] Acquiring lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e2ffb571-7108-4e4c-a8f0-161470d44f20 req-8e9b2f4d-4305-4d55-9233-5628e1ae637d service nova] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e2ffb571-7108-4e4c-a8f0-161470d44f20 req-8e9b2f4d-4305-4d55-9233-5628e1ae637d service nova] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:23 user nova-compute[70914]: DEBUG nova.compute.manager [req-e2ffb571-7108-4e4c-a8f0-161470d44f20 req-8e9b2f4d-4305-4d55-9233-5628e1ae637d service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] No waiting events found dispatching network-vif-plugged-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:01:23 user nova-compute[70914]: WARNING nova.compute.manager [req-e2ffb571-7108-4e4c-a8f0-161470d44f20 req-8e9b2f4d-4305-4d55-9233-5628e1ae637d service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received unexpected event network-vif-plugged-19753b73-1f3e-4620-832c-3d9ef7827622 for instance with vm_state building and task_state spawning.
Jul 27 14:01:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466485.4771056, aa0c73e8-873a-4ed1-9fda-373cd23a98e8 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] VM Resumed (Lifecycle Event)
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Instance spawned successfully.
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466485.4774947, aa0c73e8-873a-4ed1-9fda-373cd23a98e8 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] VM Started (Lifecycle Event)
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Took 7.92 seconds to spawn the instance on the hypervisor.
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466485.6544666, 60d35122-55c4-458e-bf51-db6d2a87b1d1 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] VM Resumed (Lifecycle Event)
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Instance spawned successfully.
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-39766fe7-8c23-4b68-910b-bb385bac0dd4 req-8d29de06-d76c-428e-b77a-676e81e6c812 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received event network-vif-plugged-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-39766fe7-8c23-4b68-910b-bb385bac0dd4 req-8d29de06-d76c-428e-b77a-676e81e6c812 service nova] Acquiring lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-39766fe7-8c23-4b68-910b-bb385bac0dd4 req-8d29de06-d76c-428e-b77a-676e81e6c812 service nova] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-39766fe7-8c23-4b68-910b-bb385bac0dd4 req-8d29de06-d76c-428e-b77a-676e81e6c812 service nova] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-39766fe7-8c23-4b68-910b-bb385bac0dd4 req-8d29de06-d76c-428e-b77a-676e81e6c812 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] No waiting events found dispatching network-vif-plugged-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:01:25 user nova-compute[70914]: WARNING nova.compute.manager [req-39766fe7-8c23-4b68-910b-bb385bac0dd4 req-8d29de06-d76c-428e-b77a-676e81e6c812 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received unexpected event network-vif-plugged-19753b73-1f3e-4620-832c-3d9ef7827622 for instance with vm_state building and task_state spawning.
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466485.658483, 60d35122-55c4-458e-bf51-db6d2a87b1d1 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] VM Started (Lifecycle Event)
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Took 8.60 seconds to build instance.
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d78bae2d-9149-4a51-98ac-df603e69131a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.730s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Took 6.33 seconds to spawn the instance on the hypervisor.
Jul 27 14:01:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:01:25 user nova-compute[70914]: INFO nova.compute.manager [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Took 7.03 seconds to build instance.
Jul 27 14:01:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1a01328b-b9f1-4ba0-bdd3-69ed3485292f tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.125s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:01:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:55 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:01:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-1345fe8d-664a-4880-aa39-1c2f7b5d413a req-b4eae6d4-5262-43b5-8cd8-9307565c48fb service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received event network-changed-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:01:57 user nova-compute[70914]: DEBUG nova.compute.manager [req-1345fe8d-664a-4880-aa39-1c2f7b5d413a req-b4eae6d4-5262-43b5-8cd8-9307565c48fb service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Refreshing instance network info cache due to event network-changed-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:01:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1345fe8d-664a-4880-aa39-1c2f7b5d413a req-b4eae6d4-5262-43b5-8cd8-9307565c48fb service nova] Acquiring lock "refresh_cache-475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:01:57 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1345fe8d-664a-4880-aa39-1c2f7b5d413a req-b4eae6d4-5262-43b5-8cd8-9307565c48fb service nova] Acquired lock "refresh_cache-475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:01:57 user nova-compute[70914]: DEBUG nova.network.neutron [req-1345fe8d-664a-4880-aa39-1c2f7b5d413a req-b4eae6d4-5262-43b5-8cd8-9307565c48fb service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Refreshing network info cache for port eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:58 user nova-compute[70914]: INFO nova.compute.manager [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Terminating instance
Jul 27 14:01:58 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG nova.network.neutron [req-1345fe8d-664a-4880-aa39-1c2f7b5d413a req-b4eae6d4-5262-43b5-8cd8-9307565c48fb service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Updated VIF entry in instance network info cache for port eccaaf5c-7ece-42d7-b9c1-57d85c5526ff. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG nova.network.neutron [req-1345fe8d-664a-4880-aa39-1c2f7b5d413a req-b4eae6d4-5262-43b5-8cd8-9307565c48fb service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Updating instance_info_cache with network_info: [{"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1345fe8d-664a-4880-aa39-1c2f7b5d413a req-b4eae6d4-5262-43b5-8cd8-9307565c48fb service nova] Releasing lock "refresh_cache-475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:58 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Instance destroyed successfully.
Jul 27 14:01:58 user nova-compute[70914]: DEBUG nova.objects.instance [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'resources' on Instance uuid 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-634105337',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-634105337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-634105337',id=43,image_ref='56129bb2-aec6-44b6-80f6-d4e172e18097',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BOCJvJG93unNBqaVgn6ysj/0WjA4JH08pySLQaZBsoc93EoKC8/aUJR67wGvpImncjQYWeD9FaIZ9q/wZ0jSTi05nE2zowOQyVhBAfrlVdxnSiLqJrSTL/mLEJyNzfA==',key_name='tempest-keypair-919152255',keypairs=<?>,launch_index=0,launched_at=2023-07-27T14:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-l6pj3tvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1923193575',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T14:00:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "address": "fa:16:3e:95:6e:b8", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccaaf5c-7e", "ovs_interfaceid": "eccaaf5c-7ece-42d7-b9c1-57d85c5526ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=eccaaf5c-7ece-42d7-b9c1-57d85c5526ff,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccaaf5c-7e') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_vif [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=eccaaf5c-7ece-42d7-b9c1-57d85c5526ff,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccaaf5c-7e') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeccaaf5c-7e, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:01:58 user nova-compute[70914]: INFO os_vif [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=eccaaf5c-7ece-42d7-b9c1-57d85c5526ff,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccaaf5c-7e')
Jul 27 14:01:58 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVobrdGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:01:58 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[55461590-815e-4bc9-88ef-7c99629ce959]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:01:58 user nova-compute[70914]: No targets found.
Jul 27 14:01:58 user nova-compute[70914]: iSNS:
Jul 27 14:01:58 user nova-compute[70914]: No targets found.
Jul 27 14:01:58 user nova-compute[70914]: STATIC:
Jul 27 14:01:58 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283
Jul 27 14:01:58 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:01:58 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:01:58 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86
Jul 27 14:01:58 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:01:58 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:01:58 user nova-compute[70914]: FIRMWARE:
Jul 27 14:01:58 user nova-compute[70914]: No targets found.
Jul 27 14:01:58 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:01:58 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:01:58 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3083ebd-aa3e-48f5-bba8-c69eebc71a62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5488740f-5395-4ffc-a6ce-ade602248591]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 14:01:58 user nova-compute[70914]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 (non-flash)
Jul 27 14:01:58 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 14:01:58 user nova-compute[70914]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 (non-flash)
Jul 27 14:01:58 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c186bec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:01:58 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9c5aa3-013e-4684-804a-6e636ce0647d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2452bf-539e-4d3a-ae56-6eb54fadf246]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee629cb7-c6a8-4a0f-a88a-b6990e80acb5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e05a3f-b2b4-4e6e-982e-ef153aabce4c]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2b3ba2a9', '/dev/disk/by-id/scsi-1SCST_BIO2b3ba2a9-245f80e35d2638a7', '/dev/disk/by-id/scsi-23234356638306533') {{(pid=82182) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78ee909-cf02-47be-b00d-4a848075b674]: (4, None) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[336952b4-c7f5-4428-a87e-6fd2a9e93a50]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70e33b4-8cca-4cfe-ba13-14978c0acf95]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86, portal: 172.16.0.220,3260]
Jul 27 14:01:59 user nova-compute[70914]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86, portal: 172.16.0.220,3260] successful.
Jul 27 14:01:59 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c4ce14-abc1-490a-91a7-069311061c86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b537276-58cb-4ddd-b16c-7bfd8c00e3b3]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== disconnect_volume: return (327ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:01:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Deleting instance files /opt/stack/data/nova/instances/475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7_del
Jul 27 14:01:59 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Deletion of /opt/stack/data/nova/instances/475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7_del complete
Jul 27 14:01:59 user nova-compute[70914]: INFO nova.compute.manager [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Took 1.25 seconds to destroy the instance on the hypervisor.
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received event network-vif-unplugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] Acquiring lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] No waiting events found dispatching network-vif-unplugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received event network-vif-unplugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received event network-vif-plugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] Acquiring lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG nova.compute.manager [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] No waiting events found dispatching network-vif-plugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:01:59 user nova-compute[70914]: WARNING nova.compute.manager [req-6c488560-ad48-4fe3-b26b-11e36dfff092 req-1e896567-056b-4e74-95b8-29be4678b16e service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received unexpected event network-vif-plugged-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff for instance with vm_state active and task_state deleting.
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:01:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.compute.manager [req-3743a96b-e37c-4d4c-aa24-91eaef83f58c req-19c5a972-ff10-46ea-b44c-9103310cfdc2 service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Received event network-vif-deleted-eccaaf5c-7ece-42d7-b9c1-57d85c5526ff {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:02:00 user nova-compute[70914]: INFO nova.compute.manager [req-3743a96b-e37c-4d4c-aa24-91eaef83f58c req-19c5a972-ff10-46ea-b44c-9103310cfdc2 service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Neutron deleted interface eccaaf5c-7ece-42d7-b9c1-57d85c5526ff; detaching it from the instance and deleting it from the info cache
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.network.neutron [req-3743a96b-e37c-4d4c-aa24-91eaef83f58c req-19c5a972-ff10-46ea-b44c-9103310cfdc2 service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:02:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:02:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8259MB free_disk=25.30440902709961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:02:00 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Took 1.49 seconds to deallocate network for instance.
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.compute.manager [req-3743a96b-e37c-4d4c-aa24-91eaef83f58c req-19c5a972-ff10-46ea-b44c-9103310cfdc2 service nova] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Detach interface failed, port_id=eccaaf5c-7ece-42d7-b9c1-57d85c5526ff, reason: Instance 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 8c04e796-5fed-4986-bd21-202b7bc843be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance aa0c73e8-873a-4ed1-9fda-373cd23a98e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:02:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:02:01 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:02:01 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:02:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:02:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:02:01 user nova-compute[70914]: INFO nova.compute.manager [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Took 0.76 seconds to detach 1 volumes for instance.
Jul 27 14:02:01 user nova-compute[70914]: DEBUG nova.compute.manager [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Deleting volume: 70c4ce14-abc1-490a-91a7-069311061c86 {{(pid=70914) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 14:02:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:02:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:02:01 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:02:01 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:02:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:02:01 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Deleted allocations for instance 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7
Jul 27 14:02:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-cb329b85-8bd3-442b-a415-2faf9ddc77e3 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.989s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:02:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:02:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:05 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:02:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 14:02:06 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:08 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:08 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:02:13 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466518.82457, 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:02:13 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] VM Stopped (Lifecycle Event)
Jul 27 14:02:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-29f23fd7-c4d7-445d-a6c7-469a97e317b7 None None] [instance: 475d1939-10f8-4a3c-ab36-8bd9cf2b5fe7] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:02:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:02:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:02:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:02:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:02:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:02:46 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 14:02:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] There are 0 instances to clean {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 14:02:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:02:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "8c04e796-5fed-4986-bd21-202b7bc843be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:02:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "8c04e796-5fed-4986-bd21-202b7bc843be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:02:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:02:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:02:52 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:02:52 user nova-compute[70914]: INFO nova.compute.manager [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Terminating instance
Jul 27 14:02:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:02:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-f89f15f0-74c4-40e4-abfe-102cfd9460f4 req-abc1c9c0-614d-4036-a887-65c5010cecec service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received event network-vif-unplugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f89f15f0-74c4-40e4-abfe-102cfd9460f4 req-abc1c9c0-614d-4036-a887-65c5010cecec service nova] Acquiring lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f89f15f0-74c4-40e4-abfe-102cfd9460f4 req-abc1c9c0-614d-4036-a887-65c5010cecec service nova] Lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-f89f15f0-74c4-40e4-abfe-102cfd9460f4 req-abc1c9c0-614d-4036-a887-65c5010cecec service nova] Lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-f89f15f0-74c4-40e4-abfe-102cfd9460f4 req-abc1c9c0-614d-4036-a887-65c5010cecec service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] No waiting events found dispatching network-vif-unplugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG nova.compute.manager [req-f89f15f0-74c4-40e4-abfe-102cfd9460f4 req-abc1c9c0-614d-4036-a887-65c5010cecec service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received event network-vif-unplugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:53 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Instance destroyed successfully.
Jul 27 14:02:53 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'resources' on Instance uuid 8c04e796-5fed-4986-bd21-202b7bc843be {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T13:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1989858646',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1989858646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1989858646',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJasvF4t0sCTZS7SU+YTdGcxrN7gWWatVzxXq5oTdl6Sh461wxdXhJsEUF4hPT/wJGdfA48Si9fInLOmFGIFVH+c6+FFujT0Oi9b2zS9ffeVis+1mdKIsMlUhU+zWZbHgg==',key_name='tempest-keypair-1917856352',keypairs=<?>,launch_index=0,launched_at=2023-07-27T13:58:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-vc5imeth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T13:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=8c04e796-5fed-4986-bd21-202b7bc843be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "address": "fa:16:3e:f2:19:8c", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b6390-aa", "ovs_interfaceid": "ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b6390-aa') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_vif [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b6390-aa') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff0b6390-aa, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:02:53 user nova-compute[70914]: INFO os_vif [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b6390-aa')
Jul 27 14:02:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFDoLhtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:02:53 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc80a47e-a733-4934-8a3a-daf47a104b64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:02:53 user nova-compute[70914]: No targets found.
Jul 27 14:02:53 user nova-compute[70914]: iSNS:
Jul 27 14:02:53 user nova-compute[70914]: No targets found.
Jul 27 14:02:53 user nova-compute[70914]: STATIC:
Jul 27 14:02:53 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283
Jul 27 14:02:53 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:02:53 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:02:53 user nova-compute[70914]: FIRMWARE:
Jul 27 14:02:53 user nova-compute[70914]: No targets found.
Jul 27 14:02:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:02:53 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:02:53 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4eb0c2-5719-4303-ac82-8cdfb3a11fbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8dd3e0-17a3-421d-9748-21d86a4f81be]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 14:02:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 (non-flash)
Jul 27 14:02:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf86d51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283'): ({'sdd'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Removing single pathed devices sdd {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[da22e03d-d7a1-4afc-b878-b345d8176019]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be1669d-f8e0-47ec-8bdf-05f3f65455d4]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flushing IO for device /dev/sdd {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2c5a7c-3389-44cd-89e0-61c63157395c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1a525a-96db-4074-b5d9-5463d170e662]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] SCSI volumes sdd have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOdd0ae156-c308275c5c035f91', '/dev/disk/by-id/scsi-26333303832373563', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_dd0ae156') {{(pid=82182) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[be826908-9c64-4085-a5c2-8d5d0fae1796]: (4, None) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfed7ccf-d85a-486e-bca9-c188835fb7e6]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaae233-bb41-492e-9ed2-b592a22e828f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283, portal: 172.16.0.220,3260]
Jul 27 14:02:53 user nova-compute[70914]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283, portal: 172.16.0.220,3260] successful.
Jul 27 14:02:53 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2463a-7edc-4960-a1c9-9b8f79740283 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db1a11c-700f-4491-8afc-204f77d95712]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== disconnect_volume: return (302ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:02:53 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:02:53 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Deleting instance files /opt/stack/data/nova/instances/8c04e796-5fed-4986-bd21-202b7bc843be_del
Jul 27 14:02:53 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Deletion of /opt/stack/data/nova/instances/8c04e796-5fed-4986-bd21-202b7bc843be_del complete
Jul 27 14:02:54 user nova-compute[70914]: INFO nova.compute.manager [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 27 14:02:54 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:02:54 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:02:54 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:02:54 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:02:54 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Took 0.81 seconds to deallocate network for instance.
Jul 27 14:02:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-0cabda31-6c8b-40b9-acc1-ba2ebe5f116f req-237e38ef-ef70-493b-bb0e-aab24f887174 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received event network-vif-deleted-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:02:54 user nova-compute[70914]: INFO nova.compute.manager [req-0cabda31-6c8b-40b9-acc1-ba2ebe5f116f req-237e38ef-ef70-493b-bb0e-aab24f887174 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Neutron deleted interface ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76; detaching it from the instance and deleting it from the info cache
Jul 27 14:02:54 user nova-compute[70914]: DEBUG nova.network.neutron [req-0cabda31-6c8b-40b9-acc1-ba2ebe5f116f req-237e38ef-ef70-493b-bb0e-aab24f887174 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:02:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-0cabda31-6c8b-40b9-acc1-ba2ebe5f116f req-237e38ef-ef70-493b-bb0e-aab24f887174 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Detach interface failed, port_id=ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76, reason: Instance 8c04e796-5fed-4986-bd21-202b7bc843be could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 14:02:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-17f51213-95b2-469a-a123-aca4fd578137 req-19711b63-81f6-4352-a949-cb21fa9f2884 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received event network-vif-plugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:02:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-17f51213-95b2-469a-a123-aca4fd578137 req-19711b63-81f6-4352-a949-cb21fa9f2884 service nova] Acquiring lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:02:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-17f51213-95b2-469a-a123-aca4fd578137 req-19711b63-81f6-4352-a949-cb21fa9f2884 service nova] Lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:02:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-17f51213-95b2-469a-a123-aca4fd578137 req-19711b63-81f6-4352-a949-cb21fa9f2884 service nova] Lock "8c04e796-5fed-4986-bd21-202b7bc843be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:02:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-17f51213-95b2-469a-a123-aca4fd578137 req-19711b63-81f6-4352-a949-cb21fa9f2884 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] No waiting events found dispatching network-vif-plugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:02:55 user nova-compute[70914]: WARNING nova.compute.manager [req-17f51213-95b2-469a-a123-aca4fd578137 req-19711b63-81f6-4352-a949-cb21fa9f2884 service nova] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Received unexpected event network-vif-plugged-ff0b6390-aaeb-4e77-ba68-9b6a2b1f5e76 for instance with vm_state active and task_state deleting.
Jul 27 14:02:55 user nova-compute[70914]: INFO nova.compute.manager [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Took 0.69 seconds to detach 1 volumes for instance.
Jul 27 14:02:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Deleting volume: cad2463a-7edc-4960-a1c9-9b8f79740283 {{(pid=70914) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 14:02:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:02:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:02:55 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:02:55 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:02:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:02:55 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Deleted allocations for instance 8c04e796-5fed-4986-bd21-202b7bc843be
Jul 27 14:02:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c3b5af92-5c66-494a-a544-ed15d896c0f4 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "8c04e796-5fed-4986-bd21-202b7bc843be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.074s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:02:56 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:02:59 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:02:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:02:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:02:59 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:02:59 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:02:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:02:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:02:59 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:03:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:03:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8580MB free_disk=25.293846130371094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance aa0c73e8-873a-4ed1-9fda-373cd23a98e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:03:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:03:01 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:03:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:03:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:03:04 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:03:07 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:03:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:03:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 14:03:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:03:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:03:07 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:03:07 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid aa0c73e8-873a-4ed1-9fda-373cd23a98e8 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-ca2d2f92-367a-47a3-a27b-592ba364a037 req-9b38f5eb-4e2e-4520-ac64-31fb1e129167 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received event network-changed-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG nova.compute.manager [req-ca2d2f92-367a-47a3-a27b-592ba364a037 req-9b38f5eb-4e2e-4520-ac64-31fb1e129167 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Refreshing instance network info cache due to event network-changed-957cfbc5-b8cd-4780-a0dc-634a3e55d46f. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ca2d2f92-367a-47a3-a27b-592ba364a037 req-9b38f5eb-4e2e-4520-ac64-31fb1e129167 service nova] Acquiring lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466573.6424465, 8c04e796-5fed-4986-bd21-202b7bc843be => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:03:08 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] VM Stopped (Lifecycle Event)
Jul 27 14:03:08 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a8f2565c-8254-44aa-8a20-8ee8401f0bd7 None None] [instance: 8c04e796-5fed-4986-bd21-202b7bc843be] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Updating instance_info_cache with network_info: [{"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ca2d2f92-367a-47a3-a27b-592ba364a037 req-9b38f5eb-4e2e-4520-ac64-31fb1e129167 service nova] Acquired lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG nova.network.neutron [req-ca2d2f92-367a-47a3-a27b-592ba364a037 req-9b38f5eb-4e2e-4520-ac64-31fb1e129167 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Refreshing network info cache for port 957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:03:08 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:03:09 user nova-compute[70914]: DEBUG nova.network.neutron [req-ca2d2f92-367a-47a3-a27b-592ba364a037 req-9b38f5eb-4e2e-4520-ac64-31fb1e129167 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Updated VIF entry in instance network info cache for port 957cfbc5-b8cd-4780-a0dc-634a3e55d46f. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:03:09 user nova-compute[70914]: DEBUG nova.network.neutron [req-ca2d2f92-367a-47a3-a27b-592ba364a037 req-9b38f5eb-4e2e-4520-ac64-31fb1e129167 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Updating instance_info_cache with network_info: [{"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:03:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ca2d2f92-367a-47a3-a27b-592ba364a037 req-9b38f5eb-4e2e-4520-ac64-31fb1e129167 service nova] Releasing lock "refresh_cache-aa0c73e8-873a-4ed1-9fda-373cd23a98e8" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:03:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:03:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:03:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-05a982b9-5c20-43df-abbc-56257f971879 req-80775e3a-e50f-4489-a9cc-1c916d1f2d2f service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received event network-changed-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:03:10 user nova-compute[70914]: DEBUG nova.compute.manager [req-05a982b9-5c20-43df-abbc-56257f971879 req-80775e3a-e50f-4489-a9cc-1c916d1f2d2f service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Refreshing instance network info cache due to event network-changed-19753b73-1f3e-4620-832c-3d9ef7827622. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:03:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-05a982b9-5c20-43df-abbc-56257f971879 req-80775e3a-e50f-4489-a9cc-1c916d1f2d2f service nova] Acquiring lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:03:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-05a982b9-5c20-43df-abbc-56257f971879 req-80775e3a-e50f-4489-a9cc-1c916d1f2d2f service nova] Acquired lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:03:10 user nova-compute[70914]: DEBUG nova.network.neutron [req-05a982b9-5c20-43df-abbc-56257f971879 req-80775e3a-e50f-4489-a9cc-1c916d1f2d2f service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Refreshing network info cache for port 19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:03:11 user nova-compute[70914]: DEBUG nova.network.neutron [req-05a982b9-5c20-43df-abbc-56257f971879 req-80775e3a-e50f-4489-a9cc-1c916d1f2d2f service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updated VIF entry in instance network info cache for port 19753b73-1f3e-4620-832c-3d9ef7827622. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:03:11 user nova-compute[70914]: DEBUG nova.network.neutron [req-05a982b9-5c20-43df-abbc-56257f971879 req-80775e3a-e50f-4489-a9cc-1c916d1f2d2f service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updating instance_info_cache with network_info: [{"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:03:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-05a982b9-5c20-43df-abbc-56257f971879 req-80775e3a-e50f-4489-a9cc-1c916d1f2d2f service nova] Releasing lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG nova.objects.instance [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'flavor' on Instance uuid aa0c73e8-873a-4ed1-9fda-373cd23a98e8 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG nova.objects.instance [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'flavor' on Instance uuid 60d35122-55c4-458e-bf51-db6d2a87b1d1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:03:12 user nova-compute[70914]: INFO nova.compute.manager [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Attaching volume dc5cd54f-bedb-4696-be9a-5918898f5545 to /dev/vdb
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:03:12 user nova-compute[70914]: INFO nova.compute.manager [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Attaching volume 43c62ddc-19c7-4919-ae0d-47bf9e8540df to /dev/vdb
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.utils [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9e068c-7caa-4270-984d-de7e88158c96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[67915c35-9057-4283-9c43-cec5289ef80d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.utils [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[43204569-d52f-4af2-b004-840be392d001]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e92495-79ec-4e2f-8f56-4156c0836ed8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d33fc4-d533-413e-b248-48a2eee01de9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:03:12 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[692e73a7-1fff-4a53-a324-0f419a572b3f]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.utils [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Updating existing volume attachment record: 6455f28d-5d0e-4b5f-8fe9-df6af03cb07d {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a6b81a-c0e6-4808-993e-b6806075a1ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[096cde1e-2cc9-4c4c-b028-5878b85693b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[655eca7a-cb28-4d3f-b970-3b97fe2591b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:03:12 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 14:03:12 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[049a8e14-9a47-408d-8143-1bd8c2d572ba]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG os_brick.utils [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:03:12 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updating existing volume attachment record: e3526045-d952-4dd0-a5c7-8f7460ed92ad {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 14:03:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:14 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:03:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances with incomplete migration  {{(pid=70914) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 14:03:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTfytBXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:03:23 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:03:23 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:03:23 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acec5c4-5eb4-4ca4-a8a8-2346609446b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 14:03:23 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8dbc44-1354-4ca2-9a2a-7678f3efcbc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545] added
Jul 27 14:03:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c811ea-7098-45d2-872c-ecd2eb3d4ea9]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b89a01-fbd4-4a0e-8960-3e9c43e1989b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTfytBXJ {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTfytBXJ" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca6b93-6cda-405f-9718-ea7f15d6d444]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PTfytBXJ'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd5ac3b-5830-43ac-b5aa-e58e56560e27]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a70617b-c40f-4e57-acd1-e472350ab811]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 14:03:23 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 14:03:23 user nova-compute[70914]:  {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:03:23 user nova-compute[70914]: WARNING os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 14:03:23 user nova-compute[70914]: 
Jul 27 14:03:23 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNkpyHGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:03:23 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f7aa7e-e6d3-47cb-84b7-553db11c1f5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545, portal: 172.16.0.220,3260]
Jul 27 14:03:23 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545, portal: 172.16.0.220,3260] successful.
Jul 27 14:03:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f636e27d-2972-48d5-a12c-65d31d4f57d5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb29750-248f-4f8a-810b-f0783221dd48]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)
Jul 27 14:03:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)
Jul 27 14:03:23 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[407f6f18-131a-4fb0-91c0-ebc53aec1891]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:03:23 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTfytBXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26263396661363631', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263396661363631', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.134s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:03:24 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:03:24 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG nova.objects.instance [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'flavor' on Instance uuid aa0c73e8-873a-4ed1-9fda-373cd23a98e8 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba6623a-c6b3-4974-99e0-b5bed3b873e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 14:03:24 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 14:03:24 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:03:24 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 14:03:24 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:03:24 user nova-compute[70914]:   <serial>dc5cd54f-bedb-4696-be9a-5918898f5545</serial>
Jul 27 14:03:24 user nova-compute[70914]: </disk>
Jul 27 14:03:24 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb1416-3874-45c4-8ecd-bafcbb56fe8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df] added
Jul 27 14:03:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[df534472-7c8b-437a-b04b-b266e6d67f41]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0873f8-0192-4df7-8228-b0c36f73b970]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNkpyHGK {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNkpyHGK" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e751e1-fb51-40e8-b7d9-8ac0dc543542]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wNkpyHGK'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7079a14d-dc78-4926-909c-cd7e36febcbd]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a02fe21-c6bc-4ea1-a1f6-86563a83e699]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)
Jul 27 14:03:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)
Jul 27 14:03:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42cdccc-91ba-409a-ba90-8fc833e8efbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df, portal: 172.16.0.220,3260]
Jul 27 14:03:24 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df, portal: 172.16.0.220,3260] successful.
Jul 27 14:03:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b334cb42-66ec-4961-91ce-2c35eb9f9a1c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e176a7f-fc49-4423-b2c4-e7bb6dabd4e6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)
Jul 27 14:03:24 user nova-compute[70914]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df (non-flash)
Jul 27 14:03:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)
Jul 27 14:03:24 user nova-compute[70914]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df (non-flash)
Jul 27 14:03:24 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 14:03:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfc67f6-afb2-4c76-811f-0a573d954b7f]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:25 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:03:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNkpyHGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 14:03:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:03:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:03:25 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No VIF found with MAC fa:16:3e:26:65:81, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:03:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-63967bb2-11d2-4037-bc8a-6dd069c67cb9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.996s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] <== connect_volume: return (2428ms) {'type': 'block', 'scsi_wwn': '26664636435633134', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664636435633134', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG nova.objects.instance [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'flavor' on Instance uuid 60d35122-55c4-458e-bf51-db6d2a87b1d1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 14:03:26 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:03:26 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 14:03:26 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:03:26 user nova-compute[70914]:   <serial>43c62ddc-19c7-4919-ae0d-47bf9e8540df</serial>
Jul 27 14:03:26 user nova-compute[70914]: </disk>
Jul 27 14:03:26 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] No VIF found with MAC fa:16:3e:ca:48:26, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-03ce4eb6-a62f-4ed3-ba1e-2ad1b163d904 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.236s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:03:26 user nova-compute[70914]: INFO nova.compute.manager [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Detaching volume dc5cd54f-bedb-4696-be9a-5918898f5545
Jul 27 14:03:26 user nova-compute[70914]: INFO nova.virt.block_device [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Attempting to driver detach volume dc5cd54f-bedb-4696-be9a-5918898f5545 from mountpoint /dev/vdb
Jul 27 14:03:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Attempting to detach device vdb from instance aa0c73e8-873a-4ed1-9fda-373cd23a98e8 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:03:26 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:03:26 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 14:03:26 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:03:26 user nova-compute[70914]:   <serial>dc5cd54f-bedb-4696-be9a-5918898f5545</serial>
Jul 27 14:03:26 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 14:03:26 user nova-compute[70914]: </disk>
Jul 27 14:03:26 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:03:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully detached device vdb from instance aa0c73e8-873a-4ed1-9fda-373cd23a98e8 from the persistent domain config.
Jul 27 14:03:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa0c73e8-873a-4ed1-9fda-373cd23a98e8 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 14:03:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:03:26 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:03:26 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 14:03:26 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:03:26 user nova-compute[70914]:   <serial>dc5cd54f-bedb-4696-be9a-5918898f5545</serial>
Jul 27 14:03:26 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 14:03:26 user nova-compute[70914]: </disk>
Jul 27 14:03:26 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690466607.257904, aa0c73e8-873a-4ed1-9fda-373cd23a98e8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa0c73e8-873a-4ed1-9fda-373cd23a98e8 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 14:03:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully detached device vdb from instance aa0c73e8-873a-4ed1-9fda-373cd23a98e8 from the live domain config.
Jul 27 14:03:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTfytBXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:03:27 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c0f25e-4899-490e-b415-864f572bf743]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:03:27 user nova-compute[70914]: No targets found.
Jul 27 14:03:27 user nova-compute[70914]: iSNS:
Jul 27 14:03:27 user nova-compute[70914]: No targets found.
Jul 27 14:03:27 user nova-compute[70914]: STATIC:
Jul 27 14:03:27 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545
Jul 27 14:03:27 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:03:27 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:03:27 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df
Jul 27 14:03:27 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:03:27 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:03:27 user nova-compute[70914]: FIRMWARE:
Jul 27 14:03:27 user nova-compute[70914]: No targets found.
Jul 27 14:03:27 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:03:27 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:03:27 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[491679d4-acc9-420c-8202-f43d82dfcf99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[665c43d8-d81c-40f2-b8dc-6b66bc46f21f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)
Jul 27 14:03:27 user nova-compute[70914]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df (non-flash)
Jul 27 14:03:27 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 (non-flash)
Jul 27 14:03:27 user nova-compute[70914]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df (non-flash)
Jul 27 14:03:27 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c47549b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[119f1eb3-1094-429f-9887-ec309bc2eafe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b20a8-0ac6-4931-a4e7-d19da4a724ef]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ff44cd-905f-4207-bdd8-faffa717dae5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e208ab-bb01-45ca-8845-2b8e4d301c1b]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2abadb0-86cd-48b1-8d40-01af7ea70fb5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cb7456-7258-4bbf-889c-4937fa963f1d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545, portal: 172.16.0.220,3260]
Jul 27 14:03:27 user nova-compute[70914]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545, portal: 172.16.0.220,3260] successful.
Jul 27 14:03:27 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5cd54f-bedb-4696-be9a-5918898f5545 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c950d4-f8f3-4c0e-a9e7-36d96f81c01c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] <== disconnect_volume: return (279ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:03:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:03:28 user nova-compute[70914]: DEBUG nova.objects.instance [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'flavor' on Instance uuid aa0c73e8-873a-4ed1-9fda-373cd23a98e8 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:03:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-74bbc0e4-4647-4572-b128-2073bcb5d70f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.588s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:03:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:03:29 user nova-compute[70914]: INFO nova.compute.manager [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Detaching volume 43c62ddc-19c7-4919-ae0d-47bf9e8540df
Jul 27 14:03:29 user nova-compute[70914]: INFO nova.virt.block_device [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Attempting to driver detach volume 43c62ddc-19c7-4919-ae0d-47bf9e8540df from mountpoint /dev/vdb
Jul 27 14:03:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Attempting to detach device vdb from instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:03:29 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:03:29 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 14:03:29 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:03:29 user nova-compute[70914]:   <serial>43c62ddc-19c7-4919-ae0d-47bf9e8540df</serial>
Jul 27 14:03:29 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 14:03:29 user nova-compute[70914]: </disk>
Jul 27 14:03:29 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:03:29 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Successfully detached device vdb from instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 from the persistent domain config.
Jul 27 14:03:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:03:29 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:03:29 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 14:03:29 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:03:29 user nova-compute[70914]:   <serial>43c62ddc-19c7-4919-ae0d-47bf9e8540df</serial>
Jul 27 14:03:29 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 14:03:29 user nova-compute[70914]: </disk>
Jul 27 14:03:29 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690466609.5775516, 60d35122-55c4-458e-bf51-db6d2a87b1d1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 14:03:29 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Successfully detached device vdb from instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 from the live domain config.
Jul 27 14:03:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNkpyHGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:03:29 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d41975a-e0e4-476b-a795-15d91fb0232e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:03:29 user nova-compute[70914]: No targets found.
Jul 27 14:03:29 user nova-compute[70914]: iSNS:
Jul 27 14:03:29 user nova-compute[70914]: No targets found.
Jul 27 14:03:29 user nova-compute[70914]: STATIC:
Jul 27 14:03:29 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df
Jul 27 14:03:29 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:03:29 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:03:29 user nova-compute[70914]: FIRMWARE:
Jul 27 14:03:29 user nova-compute[70914]: No targets found.
Jul 27 14:03:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:03:29 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:03:29 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[06188f78-9e90-4363-88c7-a1b5bb06e6d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1cee2c-afd4-4054-b169-c0c0e1f96ad7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df (non-flash)
Jul 27 14:03:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df (non-flash)
Jul 27 14:03:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18139900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df'): ({'sdc'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Removing single pathed devices sdc {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8b824e-82cf-4ff9-ae71-fd61728c39e9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfa1f6b-dc6c-4093-a3e7-d3caa33ad10d]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Flushing IO for device /dev/sdc {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a75df5-5238-4f7d-9474-617d23bbbcfd]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bd0d75-e229-411c-b9e5-e82cdff7f86b]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[34619319-a301-4bad-9e25-a7da565359eb]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95f12f1-1ef4-46e8-9841-59d4639e5f8b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df, portal: 172.16.0.220,3260]
Jul 27 14:03:29 user nova-compute[70914]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df, portal: 172.16.0.220,3260] successful.
Jul 27 14:03:29 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c62ddc-19c7-4919-ae0d-47bf9e8540df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b4367-d288-4930-9ace-e9eec8cc9a7b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] <== disconnect_volume: return (281ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:03:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:03:30 user nova-compute[70914]: DEBUG nova.objects.instance [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'flavor' on Instance uuid 60d35122-55c4-458e-bf51-db6d2a87b1d1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:03:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9a8b9694-1d2b-4ecf-b828-1efec7594cf5 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.550s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:03:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "b940e113-545b-402a-a926-4425a36e2649" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "b940e113-545b-402a-a926-4425a36e2649" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 14:03:53 user nova-compute[70914]: INFO nova.compute.claims [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Claim successful on node user
Jul 27 14:03:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Refreshing inventories for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Updating ProviderTree inventory for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Refreshing aggregate associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, aggregates: None {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Refreshing trait associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:03:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 14:03:54 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 14:03:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG nova.policy [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6161b1cf5fb4d08a8cbd36a93b8400c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ac071233d44fbb62e558725f63ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 14:03:54 user nova-compute[70914]: INFO nova.virt.block_device [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Booting with volume fe1270a3-c982-4904-98e9-c5140f6241a2 at /dev/vda
Jul 27 14:03:54 user nova-compute[70914]: DEBUG os_brick.utils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5c4b43-a77a-4a28-a5e2-273511860b2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1aefc4-f690-4f4e-b8dc-cf7e304e3554]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2ac4fa-a4de-4bf1-bba6-a372e63c555d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[438f9b3f-06a8-4532-ad99-335c4718cfde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:03:54 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 14:03:54 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2943d8dd-d79d-4fec-aa97-a1aa3c0c2346]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG os_brick.utils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Updating existing volume attachment record: d8947280-10af-4a29-aea0-3ef0c637b0e1 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 14:03:54 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Successfully created port: 01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 14:03:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Successfully updated port: 01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 14:03:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "refresh_cache-b940e113-545b-402a-a926-4425a36e2649" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:03:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquired lock "refresh_cache-b940e113-545b-402a-a926-4425a36e2649" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:03:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 14:03:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-c307b6e9-ce90-4891-95be-a31139b24733 req-f06de24c-8d45-4a87-9c99-82a23bd909d3 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received event network-changed-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:03:55 user nova-compute[70914]: DEBUG nova.compute.manager [req-c307b6e9-ce90-4891-95be-a31139b24733 req-f06de24c-8d45-4a87-9c99-82a23bd909d3 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Refreshing instance network info cache due to event network-changed-01996231-68c0-422f-af34-34c33bef42f2. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:03:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c307b6e9-ce90-4891-95be-a31139b24733 req-f06de24c-8d45-4a87-9c99-82a23bd909d3 service nova] Acquiring lock "refresh_cache-b940e113-545b-402a-a926-4425a36e2649" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:03:55 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 14:03:56 user nova-compute[70914]: DEBUG nova.network.neutron [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Updating instance_info_cache with network_info: [{"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:03:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Releasing lock "refresh_cache-b940e113-545b-402a-a926-4425a36e2649" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:03:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Instance network_info: |[{"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 14:03:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c307b6e9-ce90-4891-95be-a31139b24733 req-f06de24c-8d45-4a87-9c99-82a23bd909d3 service nova] Acquired lock "refresh_cache-b940e113-545b-402a-a926-4425a36e2649" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:03:56 user nova-compute[70914]: DEBUG nova.network.neutron [req-c307b6e9-ce90-4891-95be-a31139b24733 req-f06de24c-8d45-4a87-9c99-82a23bd909d3 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Refreshing network info cache for port 01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:03:56 user nova-compute[70914]: DEBUG nova.network.neutron [req-c307b6e9-ce90-4891-95be-a31139b24733 req-f06de24c-8d45-4a87-9c99-82a23bd909d3 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Updated VIF entry in instance network info cache for port 01996231-68c0-422f-af34-34c33bef42f2. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:03:56 user nova-compute[70914]: DEBUG nova.network.neutron [req-c307b6e9-ce90-4891-95be-a31139b24733 req-f06de24c-8d45-4a87-9c99-82a23bd909d3 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Updating instance_info_cache with network_info: [{"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:03:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c307b6e9-ce90-4891-95be-a31139b24733 req-f06de24c-8d45-4a87-9c99-82a23bd909d3 service nova] Releasing lock "refresh_cache-b940e113-545b-402a-a926-4425a36e2649" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:03:56 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:03:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 14:04:00 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Creating image(s)
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Ensure instance console log exists: /opt/stack/data/nova/instances/b940e113-545b-402a-a926-4425a36e2649/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Start _get_guest_xml network_info=[{"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'd8947280-10af-4a29-aea0-3ef0c637b0e1', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOSsjWMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b940e113-545b-402a-a926-4425a36e2649', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe1270a3-c982-4904-98e9-c5140f6241a2', 'serial': 'fe1270a3-c982-4904-98e9-c5140f6241a2'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 14:04:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:04:00 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 14:04:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOSsjWMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:04:01 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:04:01 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:04:01 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d43175-eb7f-4425-b92d-a0245ae9aa73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 14:04:01 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba572aa-6116-4444-8efc-17f2de655fc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2] added
Jul 27 14:04:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee10b8e-2638-4d04-8e50-be0ab9fcd463]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddeae09-ad4e-47cc-9400-393a99fdb3ce]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JOSsjWMp {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JOSsjWMp" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[06835534-d384-4a5f-902b-19e92126b824]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JOSsjWMp'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1575d0-3e7c-4b6b-9f25-055f1072322f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1844ab-ab6b-4f8f-b70c-427ac47da4b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 14:04:01 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 14:04:01 user nova-compute[70914]:  {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:04:01 user nova-compute[70914]: WARNING os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 14:04:01 user nova-compute[70914]: 
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a729f6-9426-4633-ae16-1a55e59437f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260]
Jul 27 14:04:01 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260] successful.
Jul 27 14:04:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[939121ee-bf95-4453-a771-3e64327013d7]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[502b9d9d-838a-48d3-a1db-c782e6569d77]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:04:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:04:01 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ffa46-4f6d-47a8-ba85-412f085a692a]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOSsjWMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.689s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== connect_volume: return (691ms) {'type': 'block', 'scsi_wwn': '23239333939393136', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239333939393136', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 14:04:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:04:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8584MB free_disk=25.291282653808594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-908783433',display_name='tempest-TestVolumeBootPattern-server-908783433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-908783433',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTIlETEzrlhBz6OePq01eKR0vcasXvXhxqFCkGLx2Csd5vC2HyUqXiG76OOALVAFV1uvdeTYYEQFTuaa0BMfwlQOyATH6cj50OJFdi8LwK7LlbSEfvUgqiY4m0oMQIcqg==',key_name='tempest-TestVolumeBootPattern-1266066309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-rytxlcby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:03:54Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=b940e113-545b-402a-a926-4425a36e2649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5a:78,bridge_name='br-int',has_traffic_filtering=True,id=01996231-68c0-422f-af34-34c33bef42f2,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01996231-68') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.objects.instance [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'pci_devices' on Instance uuid b940e113-545b-402a-a926-4425a36e2649 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] End _get_guest_xml xml=<domain type="kvm">
Jul 27 14:04:01 user nova-compute[70914]:   <uuid>b940e113-545b-402a-a926-4425a36e2649</uuid>
Jul 27 14:04:01 user nova-compute[70914]:   <name>instance-0000002e</name>
Jul 27 14:04:01 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 14:04:01 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 14:04:01 user nova-compute[70914]:   <metadata>
Jul 27 14:04:01 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 14:04:01 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 14:04:01 user nova-compute[70914]:       <nova:name>tempest-TestVolumeBootPattern-server-908783433</nova:name>
Jul 27 14:04:01 user nova-compute[70914]:       <nova:creationTime>2023-07-27 14:04:00</nova:creationTime>
Jul 27 14:04:01 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 14:04:01 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 14:04:01 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 14:04:01 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 14:04:01 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 14:04:01 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 14:04:01 user nova-compute[70914]:       </nova:flavor>
Jul 27 14:04:01 user nova-compute[70914]:       <nova:owner>
Jul 27 14:04:01 user nova-compute[70914]:         <nova:user uuid="b6161b1cf5fb4d08a8cbd36a93b8400c">tempest-TestVolumeBootPattern-1923193575-project-member</nova:user>
Jul 27 14:04:01 user nova-compute[70914]:         <nova:project uuid="c73ac071233d44fbb62e558725f63ef8">tempest-TestVolumeBootPattern-1923193575</nova:project>
Jul 27 14:04:01 user nova-compute[70914]:       </nova:owner>
Jul 27 14:04:01 user nova-compute[70914]:       <nova:ports>
Jul 27 14:04:01 user nova-compute[70914]:         <nova:port uuid="01996231-68c0-422f-af34-34c33bef42f2">
Jul 27 14:04:01 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 14:04:01 user nova-compute[70914]:         </nova:port>
Jul 27 14:04:01 user nova-compute[70914]:       </nova:ports>
Jul 27 14:04:01 user nova-compute[70914]:     </nova:instance>
Jul 27 14:04:01 user nova-compute[70914]:   </metadata>
Jul 27 14:04:01 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 14:04:01 user nova-compute[70914]:     <system>
Jul 27 14:04:01 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 14:04:01 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 14:04:01 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 14:04:01 user nova-compute[70914]:       <entry name="serial">b940e113-545b-402a-a926-4425a36e2649</entry>
Jul 27 14:04:01 user nova-compute[70914]:       <entry name="uuid">b940e113-545b-402a-a926-4425a36e2649</entry>
Jul 27 14:04:01 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 14:04:01 user nova-compute[70914]:     </system>
Jul 27 14:04:01 user nova-compute[70914]:   </sysinfo>
Jul 27 14:04:01 user nova-compute[70914]:   <os>
Jul 27 14:04:01 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 14:04:01 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 14:04:01 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 14:04:01 user nova-compute[70914]:   </os>
Jul 27 14:04:01 user nova-compute[70914]:   <features>
Jul 27 14:04:01 user nova-compute[70914]:     <acpi/>
Jul 27 14:04:01 user nova-compute[70914]:     <apic/>
Jul 27 14:04:01 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 14:04:01 user nova-compute[70914]:   </features>
Jul 27 14:04:01 user nova-compute[70914]:   <clock offset="utc">
Jul 27 14:04:01 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 14:04:01 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 14:04:01 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 14:04:01 user nova-compute[70914]:   </clock>
Jul 27 14:04:01 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 14:04:01 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 14:04:01 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 14:04:01 user nova-compute[70914]:   </cpu>
Jul 27 14:04:01 user nova-compute[70914]:   <devices>
Jul 27 14:04:01 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 14:04:01 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:04:01 user nova-compute[70914]:       <source dev="/dev/sdb"/>
Jul 27 14:04:01 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 14:04:01 user nova-compute[70914]:       <serial>fe1270a3-c982-4904-98e9-c5140f6241a2</serial>
Jul 27 14:04:01 user nova-compute[70914]:     </disk>
Jul 27 14:04:01 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 14:04:01 user nova-compute[70914]:       <mac address="fa:16:3e:61:5a:78"/>
Jul 27 14:04:01 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:04:01 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 14:04:01 user nova-compute[70914]:       <target dev="tap01996231-68"/>
Jul 27 14:04:01 user nova-compute[70914]:     </interface>
Jul 27 14:04:01 user nova-compute[70914]:     <serial type="pty">
Jul 27 14:04:01 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/b940e113-545b-402a-a926-4425a36e2649/console.log" append="off"/>
Jul 27 14:04:01 user nova-compute[70914]:     </serial>
Jul 27 14:04:01 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 14:04:01 user nova-compute[70914]:     <video>
Jul 27 14:04:01 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:04:01 user nova-compute[70914]:     </video>
Jul 27 14:04:01 user nova-compute[70914]:     <rng model="virtio">
Jul 27 14:04:01 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 14:04:01 user nova-compute[70914]:     </rng>
Jul 27 14:04:01 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 14:04:01 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 14:04:01 user nova-compute[70914]:       <stats period="10"/>
Jul 27 14:04:01 user nova-compute[70914]:     </memballoon>
Jul 27 14:04:01 user nova-compute[70914]:   </devices>
Jul 27 14:04:01 user nova-compute[70914]: </domain>
Jul 27 14:04:01 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-908783433',display_name='tempest-TestVolumeBootPattern-server-908783433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-908783433',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTIlETEzrlhBz6OePq01eKR0vcasXvXhxqFCkGLx2Csd5vC2HyUqXiG76OOALVAFV1uvdeTYYEQFTuaa0BMfwlQOyATH6cj50OJFdi8LwK7LlbSEfvUgqiY4m0oMQIcqg==',key_name='tempest-TestVolumeBootPattern-1266066309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-rytxlcby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:03:54Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=b940e113-545b-402a-a926-4425a36e2649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5a:78,bridge_name='br-int',has_traffic_filtering=True,id=01996231-68c0-422f-af34-34c33bef42f2,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01996231-68') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG os_vif [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5a:78,bridge_name='br-int',has_traffic_filtering=True,id=01996231-68c0-422f-af34-34c33bef42f2,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01996231-68') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01996231-68, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01996231-68, col_values=(('external_ids', {'iface-id': '01996231-68c0-422f-af34-34c33bef42f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:5a:78', 'vm-uuid': 'b940e113-545b-402a-a926-4425a36e2649'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:01 user nova-compute[70914]: INFO os_vif [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5a:78,bridge_name='br-int',has_traffic_filtering=True,id=01996231-68c0-422f-af34-34c33bef42f2,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01996231-68')
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance aa0c73e8-873a-4ed1-9fda-373cd23a98e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance b940e113-545b-402a-a926-4425a36e2649 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No VIF found with MAC fa:16:3e:61:5a:78, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:04:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-4728a089-c247-4489-864d-7b9f2b6e5fae req-b308aa5f-56ad-45a4-acef-0a006f4d8ded service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received event network-vif-plugged-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4728a089-c247-4489-864d-7b9f2b6e5fae req-b308aa5f-56ad-45a4-acef-0a006f4d8ded service nova] Acquiring lock "b940e113-545b-402a-a926-4425a36e2649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4728a089-c247-4489-864d-7b9f2b6e5fae req-b308aa5f-56ad-45a4-acef-0a006f4d8ded service nova] Lock "b940e113-545b-402a-a926-4425a36e2649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4728a089-c247-4489-864d-7b9f2b6e5fae req-b308aa5f-56ad-45a4-acef-0a006f4d8ded service nova] Lock "b940e113-545b-402a-a926-4425a36e2649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-4728a089-c247-4489-864d-7b9f2b6e5fae req-b308aa5f-56ad-45a4-acef-0a006f4d8ded service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] No waiting events found dispatching network-vif-plugged-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:04:03 user nova-compute[70914]: WARNING nova.compute.manager [req-4728a089-c247-4489-864d-7b9f2b6e5fae req-b308aa5f-56ad-45a4-acef-0a006f4d8ded service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received unexpected event network-vif-plugged-01996231-68c0-422f-af34-34c33bef42f2 for instance with vm_state building and task_state spawning.
Jul 27 14:04:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:04:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466645.1577837, b940e113-545b-402a-a926-4425a36e2649 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:04:05 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b940e113-545b-402a-a926-4425a36e2649] VM Resumed (Lifecycle Event)
Jul 27 14:04:05 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: b940e113-545b-402a-a926-4425a36e2649] Instance spawned successfully.
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b940e113-545b-402a-a926-4425a36e2649] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b940e113-545b-402a-a926-4425a36e2649] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:04:05 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b940e113-545b-402a-a926-4425a36e2649] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466645.1582537, b940e113-545b-402a-a926-4425a36e2649 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:04:05 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b940e113-545b-402a-a926-4425a36e2649] VM Started (Lifecycle Event)
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b940e113-545b-402a-a926-4425a36e2649] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b940e113-545b-402a-a926-4425a36e2649] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:04:05 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: b940e113-545b-402a-a926-4425a36e2649] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:04:05 user nova-compute[70914]: INFO nova.compute.manager [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Took 4.33 seconds to spawn the instance on the hypervisor.
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.compute.manager [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:04:05 user nova-compute[70914]: INFO nova.compute.manager [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Took 11.86 seconds to build instance.
Jul 27 14:04:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-1c86756e-338f-4819-8492-2edf588b0851 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "b940e113-545b-402a-a926-4425a36e2649" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.960s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-1a04a124-9924-49a9-a010-50f0adaf9f56 req-66198b3d-8dd6-4a78-bcab-d71ab8ca6082 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received event network-vif-plugged-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1a04a124-9924-49a9-a010-50f0adaf9f56 req-66198b3d-8dd6-4a78-bcab-d71ab8ca6082 service nova] Acquiring lock "b940e113-545b-402a-a926-4425a36e2649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1a04a124-9924-49a9-a010-50f0adaf9f56 req-66198b3d-8dd6-4a78-bcab-d71ab8ca6082 service nova] Lock "b940e113-545b-402a-a926-4425a36e2649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1a04a124-9924-49a9-a010-50f0adaf9f56 req-66198b3d-8dd6-4a78-bcab-d71ab8ca6082 service nova] Lock "b940e113-545b-402a-a926-4425a36e2649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:05 user nova-compute[70914]: DEBUG nova.compute.manager [req-1a04a124-9924-49a9-a010-50f0adaf9f56 req-66198b3d-8dd6-4a78-bcab-d71ab8ca6082 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] No waiting events found dispatching network-vif-plugged-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:04:05 user nova-compute[70914]: WARNING nova.compute.manager [req-1a04a124-9924-49a9-a010-50f0adaf9f56 req-66198b3d-8dd6-4a78-bcab-d71ab8ca6082 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received unexpected event network-vif-plugged-01996231-68c0-422f-af34-34c33bef42f2 for instance with vm_state active and task_state None.
Jul 27 14:04:06 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:04:06 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:04:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:08 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:04:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:04:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:04:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:04:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:04:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:04:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:10 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updating instance_info_cache with network_info: [{"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:04:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:04:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:04:10 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:04:10 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:04:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:17 user nova-compute[70914]: INFO nova.compute.manager [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Terminating instance
Jul 27 14:04:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-9c2adfa9-231f-461b-9198-c66e93a4d061 req-34c5dc70-ec32-4c1d-8a6e-7bd0423212b0 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received event network-vif-unplugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9c2adfa9-231f-461b-9198-c66e93a4d061 req-34c5dc70-ec32-4c1d-8a6e-7bd0423212b0 service nova] Acquiring lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9c2adfa9-231f-461b-9198-c66e93a4d061 req-34c5dc70-ec32-4c1d-8a6e-7bd0423212b0 service nova] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9c2adfa9-231f-461b-9198-c66e93a4d061 req-34c5dc70-ec32-4c1d-8a6e-7bd0423212b0 service nova] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-9c2adfa9-231f-461b-9198-c66e93a4d061 req-34c5dc70-ec32-4c1d-8a6e-7bd0423212b0 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] No waiting events found dispatching network-vif-unplugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG nova.compute.manager [req-9c2adfa9-231f-461b-9198-c66e93a4d061 req-34c5dc70-ec32-4c1d-8a6e-7bd0423212b0 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received event network-vif-unplugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:04:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Instance destroyed successfully.
Jul 27 14:04:17 user nova-compute[70914]: DEBUG nova.objects.instance [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'resources' on Instance uuid aa0c73e8-873a-4ed1-9fda-373cd23a98e8 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-875178706',display_name='tempest-AttachVolumeNegativeTest-server-875178706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-875178706',id=44,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzrXHxPx9tH/CBro2HYB1z+5GjQdqGIdKoaVzz3mPWnJxRUxMrTeJvBeOHG55GN3H1/Opp9/K/2xgr7k7Tzx1HaSG1Gy2OvZigWZLw2uNw8ft4vsJDhWOIYzrQgJDH7Aw==',key_name='tempest-keypair-889281859',keypairs=<?>,launch_index=0,launched_at=2023-07-27T14:01:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-8cjagl1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T14:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=aa0c73e8-873a-4ed1-9fda-373cd23a98e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "address": "fa:16:3e:26:65:81", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957cfbc5-b8", "ovs_interfaceid": "957cfbc5-b8cd-4780-a0dc-634a3e55d46f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:65:81,bridge_name='br-int',has_traffic_filtering=True,id=957cfbc5-b8cd-4780-a0dc-634a3e55d46f,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957cfbc5-b8') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG os_vif [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:65:81,bridge_name='br-int',has_traffic_filtering=True,id=957cfbc5-b8cd-4780-a0dc-634a3e55d46f,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957cfbc5-b8') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap957cfbc5-b8, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:04:17 user nova-compute[70914]: INFO os_vif [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:65:81,bridge_name='br-int',has_traffic_filtering=True,id=957cfbc5-b8cd-4780-a0dc-634a3e55d46f,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957cfbc5-b8')
Jul 27 14:04:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Deleting instance files /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8_del
Jul 27 14:04:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Deletion of /opt/stack/data/nova/instances/aa0c73e8-873a-4ed1-9fda-373cd23a98e8_del complete
Jul 27 14:04:17 user nova-compute[70914]: INFO nova.compute.manager [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 27 14:04:17 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:04:17 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:04:18 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:04:18 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Took 0.90 seconds to deallocate network for instance.
Jul 27 14:04:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:19 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:04:19 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:04:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:19 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Deleted allocations for instance aa0c73e8-873a-4ed1-9fda-373cd23a98e8
Jul 27 14:04:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-8581bbc2-5bc0-4889-8404-dd3f6e5c326a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.260s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-bcc90903-1b59-4cab-9815-bf4894308c20 req-1877ed58-452a-4946-8553-ed6758be29f8 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received event network-vif-plugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:04:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bcc90903-1b59-4cab-9815-bf4894308c20 req-1877ed58-452a-4946-8553-ed6758be29f8 service nova] Acquiring lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bcc90903-1b59-4cab-9815-bf4894308c20 req-1877ed58-452a-4946-8553-ed6758be29f8 service nova] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bcc90903-1b59-4cab-9815-bf4894308c20 req-1877ed58-452a-4946-8553-ed6758be29f8 service nova] Lock "aa0c73e8-873a-4ed1-9fda-373cd23a98e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-bcc90903-1b59-4cab-9815-bf4894308c20 req-1877ed58-452a-4946-8553-ed6758be29f8 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] No waiting events found dispatching network-vif-plugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:04:19 user nova-compute[70914]: WARNING nova.compute.manager [req-bcc90903-1b59-4cab-9815-bf4894308c20 req-1877ed58-452a-4946-8553-ed6758be29f8 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received unexpected event network-vif-plugged-957cfbc5-b8cd-4780-a0dc-634a3e55d46f for instance with vm_state deleted and task_state None.
Jul 27 14:04:19 user nova-compute[70914]: DEBUG nova.compute.manager [req-bcc90903-1b59-4cab-9815-bf4894308c20 req-1877ed58-452a-4946-8553-ed6758be29f8 service nova] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Received event network-vif-deleted-957cfbc5-b8cd-4780-a0dc-634a3e55d46f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:04:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:04:25 user nova-compute[70914]: INFO nova.compute.manager [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] instance snapshotting
Jul 27 14:04:25 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Beginning live snapshot process
Jul 27 14:04:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json -f qcow2 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json -f qcow2 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw5jqcdmq/9aa48205a2d4461583f99ab3c7fd0ace.delta 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:26 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw5jqcdmq/9aa48205a2d4461583f99ab3c7fd0ace.delta 1073741824" returned: 0 in 0.061s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 14:04:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] COPY block job progress, current cursor: 327680 final cursor: 75563008 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 14:04:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70914) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 14:04:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 14:04:27 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 14:04:27 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw5jqcdmq/9aa48205a2d4461583f99ab3c7fd0ace.delta /opt/stack/data/nova/instances/snapshots/tmpw5jqcdmq/9aa48205a2d4461583f99ab3c7fd0ace {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw5jqcdmq/9aa48205a2d4461583f99ab3c7fd0ace.delta /opt/stack/data/nova/instances/snapshots/tmpw5jqcdmq/9aa48205a2d4461583f99ab3c7fd0ace" returned: 0 in 0.489s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:28 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Snapshot extracted, beginning image upload
Jul 27 14:04:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Snapshot image upload complete
Jul 27 14:04:30 user nova-compute[70914]: INFO nova.compute.manager [None req-fe1718c3-5456-4c7d-bb31-84b70286efcd tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Took 4.91 seconds to snapshot the instance on the hypervisor.
Jul 27 14:04:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 14:04:32 user nova-compute[70914]: INFO nova.compute.claims [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Claim successful on node user
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 14:04:32 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466657.8568225, aa0c73e8-873a-4ed1-9fda-373cd23a98e8 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:04:32 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] VM Stopped (Lifecycle Event)
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 14:04:32 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Creating image(s)
Jul 27 14:04:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "/opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "/opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "97203ab909d50f9548cae25d372d8acdcae98eca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "97203ab909d50f9548cae25d372d8acdcae98eca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.policy [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '643c0433178c46d084bcf154c766aa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dfe41ebcf84a7597ea5721759b068f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0c7102a4-fabe-4ac9-b1e9-145210d3d7d3 None None] [instance: aa0c73e8-873a-4ed1-9fda-373cd23a98e8] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:04:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:33 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca.part --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca.part --force-share --output=json" returned: 0 in 0.161s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG nova.virt.images [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] a46b00b5-f508-4098-a58b-ffcaa55dde09 was qcow2, converting to raw {{(pid=70914) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG nova.privsep.utils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70914) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca.part /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca.converted {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca.part /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca.converted" returned: 0 in 0.285s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca.converted --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca.converted --force-share --output=json" returned: 0 in 0.161s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "97203ab909d50f9548cae25d372d8acdcae98eca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.678s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Successfully created port: c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca --force-share --output=json" returned: 0 in 0.154s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "97203ab909d50f9548cae25d372d8acdcae98eca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "97203ab909d50f9548cae25d372d8acdcae98eca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca,backing_fmt=raw /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca,backing_fmt=raw /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk 1073741824" returned: 0 in 0.050s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "97203ab909d50f9548cae25d372d8acdcae98eca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'migration_context' on Instance uuid 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Ensure instance console log exists: /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Successfully updated port: c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquired lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-dafe35e6-8ae4-4988-ab0e-b2db82ec7b87 req-e6aad1fa-f7a1-47d8-a233-03b029772b50 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received event network-changed-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-dafe35e6-8ae4-4988-ab0e-b2db82ec7b87 req-e6aad1fa-f7a1-47d8-a233-03b029772b50 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Refreshing instance network info cache due to event network-changed-c7ad19f5-97e6-431b-bd8f-4a769804e27f. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dafe35e6-8ae4-4988-ab0e-b2db82ec7b87 req-e6aad1fa-f7a1-47d8-a233-03b029772b50 service nova] Acquiring lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 14:04:35 user nova-compute[70914]: DEBUG nova.network.neutron [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updating instance_info_cache with network_info: [{"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Releasing lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Instance network_info: |[{"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dafe35e6-8ae4-4988-ab0e-b2db82ec7b87 req-e6aad1fa-f7a1-47d8-a233-03b029772b50 service nova] Acquired lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.network.neutron [req-dafe35e6-8ae4-4988-ab0e-b2db82ec7b87 req-e6aad1fa-f7a1-47d8-a233-03b029772b50 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Refreshing network info cache for port c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Start _get_guest_xml network_info=[{"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b38e8536575db7d97b02372963c30063',container_format='bare',created_at=2023-07-27T14:04:25Z,direct_url=<?>,disk_format='qcow2',id=a46b00b5-f508-4098-a58b-ffcaa55dde09,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1398748883',owner='47dfe41ebcf84a7597ea5721759b068f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T14:04:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'a46b00b5-f508-4098-a58b-ffcaa55dde09'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 14:04:36 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:04:36 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b38e8536575db7d97b02372963c30063',container_format='bare',created_at=2023-07-27T14:04:25Z,direct_url=<?>,disk_format='qcow2',id=a46b00b5-f508-4098-a58b-ffcaa55dde09,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1398748883',owner='47dfe41ebcf84a7597ea5721759b068f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T14:04:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1400586611',display_name='tempest-TestStampPattern-server-1400586611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1400586611',id=47,image_ref='a46b00b5-f508-4098-a58b-ffcaa55dde09',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmLBSHyza1ghqnyyQ42csa2OCb7CLlsDqq29Po3ZvJ5ZlfPbjKBzUNAtQpBtn8A2PGxT1NM6sUeoKBKRpDDoEXF0T9Pf9kYEfBvWYc34edA7pq6zvHJD5NDhZdwsPGjdA==',key_name='tempest-TestStampPattern-1764772644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47dfe41ebcf84a7597ea5721759b068f',ramdisk_id='',reservation_id='r-9jmdm1ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60d35122-55c4-458e-bf51-db6d2a87b1d1',image_min_disk='1',image_min_ram='0',image_owner_id='47dfe41ebcf84a7597ea5721759b068f',image_owner_project_name='tempest-TestStampPattern-1948059244',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1948059244-project-member',image_user_id='643c0433178c46d084bcf154c766aa36',network_allocated='True',owner_project_name='tempest-TestStampPattern-1948059244',owner_user_name='tempest-TestStampPattern-1948059244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:04:33Z,user_data=None,user_id='643c0433178c46d084bcf154c766aa36',uuid=3c00cd20-63d3-4e80-a8f9-b3b684c12b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converting VIF {"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:17:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ad19f5-97e6-431b-bd8f-4a769804e27f,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ad19f5-97') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.objects.instance [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 14:04:36 user nova-compute[70914]:   <uuid>3c00cd20-63d3-4e80-a8f9-b3b684c12b2f</uuid>
Jul 27 14:04:36 user nova-compute[70914]:   <name>instance-0000002f</name>
Jul 27 14:04:36 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 14:04:36 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 14:04:36 user nova-compute[70914]:   <metadata>
Jul 27 14:04:36 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 14:04:36 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 14:04:36 user nova-compute[70914]:       <nova:name>tempest-TestStampPattern-server-1400586611</nova:name>
Jul 27 14:04:36 user nova-compute[70914]:       <nova:creationTime>2023-07-27 14:04:36</nova:creationTime>
Jul 27 14:04:36 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 14:04:36 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 14:04:36 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 14:04:36 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 14:04:36 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 14:04:36 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 14:04:36 user nova-compute[70914]:       </nova:flavor>
Jul 27 14:04:36 user nova-compute[70914]:       <nova:owner>
Jul 27 14:04:36 user nova-compute[70914]:         <nova:user uuid="643c0433178c46d084bcf154c766aa36">tempest-TestStampPattern-1948059244-project-member</nova:user>
Jul 27 14:04:36 user nova-compute[70914]:         <nova:project uuid="47dfe41ebcf84a7597ea5721759b068f">tempest-TestStampPattern-1948059244</nova:project>
Jul 27 14:04:36 user nova-compute[70914]:       </nova:owner>
Jul 27 14:04:36 user nova-compute[70914]:       <nova:root type="image" uuid="a46b00b5-f508-4098-a58b-ffcaa55dde09"/>
Jul 27 14:04:36 user nova-compute[70914]:       <nova:ports>
Jul 27 14:04:36 user nova-compute[70914]:         <nova:port uuid="c7ad19f5-97e6-431b-bd8f-4a769804e27f">
Jul 27 14:04:36 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 14:04:36 user nova-compute[70914]:         </nova:port>
Jul 27 14:04:36 user nova-compute[70914]:       </nova:ports>
Jul 27 14:04:36 user nova-compute[70914]:     </nova:instance>
Jul 27 14:04:36 user nova-compute[70914]:   </metadata>
Jul 27 14:04:36 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 14:04:36 user nova-compute[70914]:     <system>
Jul 27 14:04:36 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 14:04:36 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 14:04:36 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 14:04:36 user nova-compute[70914]:       <entry name="serial">3c00cd20-63d3-4e80-a8f9-b3b684c12b2f</entry>
Jul 27 14:04:36 user nova-compute[70914]:       <entry name="uuid">3c00cd20-63d3-4e80-a8f9-b3b684c12b2f</entry>
Jul 27 14:04:36 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 14:04:36 user nova-compute[70914]:     </system>
Jul 27 14:04:36 user nova-compute[70914]:   </sysinfo>
Jul 27 14:04:36 user nova-compute[70914]:   <os>
Jul 27 14:04:36 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 14:04:36 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 14:04:36 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 14:04:36 user nova-compute[70914]:   </os>
Jul 27 14:04:36 user nova-compute[70914]:   <features>
Jul 27 14:04:36 user nova-compute[70914]:     <acpi/>
Jul 27 14:04:36 user nova-compute[70914]:     <apic/>
Jul 27 14:04:36 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 14:04:36 user nova-compute[70914]:   </features>
Jul 27 14:04:36 user nova-compute[70914]:   <clock offset="utc">
Jul 27 14:04:36 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 14:04:36 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 14:04:36 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 14:04:36 user nova-compute[70914]:   </clock>
Jul 27 14:04:36 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 14:04:36 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 14:04:36 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 14:04:36 user nova-compute[70914]:   </cpu>
Jul 27 14:04:36 user nova-compute[70914]:   <devices>
Jul 27 14:04:36 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 14:04:36 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 14:04:36 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk"/>
Jul 27 14:04:36 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 14:04:36 user nova-compute[70914]:     </disk>
Jul 27 14:04:36 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 14:04:36 user nova-compute[70914]:       <mac address="fa:16:3e:57:17:18"/>
Jul 27 14:04:36 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:04:36 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 14:04:36 user nova-compute[70914]:       <target dev="tapc7ad19f5-97"/>
Jul 27 14:04:36 user nova-compute[70914]:     </interface>
Jul 27 14:04:36 user nova-compute[70914]:     <serial type="pty">
Jul 27 14:04:36 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/console.log" append="off"/>
Jul 27 14:04:36 user nova-compute[70914]:     </serial>
Jul 27 14:04:36 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 14:04:36 user nova-compute[70914]:     <video>
Jul 27 14:04:36 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:04:36 user nova-compute[70914]:     </video>
Jul 27 14:04:36 user nova-compute[70914]:     <rng model="virtio">
Jul 27 14:04:36 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 14:04:36 user nova-compute[70914]:     </rng>
Jul 27 14:04:36 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 14:04:36 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 14:04:36 user nova-compute[70914]:       <stats period="10"/>
Jul 27 14:04:36 user nova-compute[70914]:     </memballoon>
Jul 27 14:04:36 user nova-compute[70914]:   </devices>
Jul 27 14:04:36 user nova-compute[70914]: </domain>
Jul 27 14:04:36 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1400586611',display_name='tempest-TestStampPattern-server-1400586611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1400586611',id=47,image_ref='a46b00b5-f508-4098-a58b-ffcaa55dde09',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmLBSHyza1ghqnyyQ42csa2OCb7CLlsDqq29Po3ZvJ5ZlfPbjKBzUNAtQpBtn8A2PGxT1NM6sUeoKBKRpDDoEXF0T9Pf9kYEfBvWYc34edA7pq6zvHJD5NDhZdwsPGjdA==',key_name='tempest-TestStampPattern-1764772644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47dfe41ebcf84a7597ea5721759b068f',ramdisk_id='',reservation_id='r-9jmdm1ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60d35122-55c4-458e-bf51-db6d2a87b1d1',image_min_disk='1',image_min_ram='0',image_owner_id='47dfe41ebcf84a7597ea5721759b068f',image_owner_project_name='tempest-TestStampPattern-1948059244',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1948059244-project-member',image_user_id='643c0433178c46d084bcf154c766aa36',network_allocated='True',owner_project_name='tempest-TestStampPattern-1948059244',owner_user_name='tempest-TestStampPattern-1948059244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:04:33Z,user_data=None,user_id='643c0433178c46d084bcf154c766aa36',uuid=3c00cd20-63d3-4e80-a8f9-b3b684c12b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converting VIF {"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:17:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ad19f5-97e6-431b-bd8f-4a769804e27f,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ad19f5-97') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG os_vif [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:17:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ad19f5-97e6-431b-bd8f-4a769804e27f,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ad19f5-97') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7ad19f5-97, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7ad19f5-97, col_values=(('external_ids', {'iface-id': 'c7ad19f5-97e6-431b-bd8f-4a769804e27f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:17:18', 'vm-uuid': '3c00cd20-63d3-4e80-a8f9-b3b684c12b2f'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:36 user nova-compute[70914]: INFO os_vif [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:17:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ad19f5-97e6-431b-bd8f-4a769804e27f,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ad19f5-97')
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] No VIF found with MAC fa:16:3e:57:17:18, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.network.neutron [req-dafe35e6-8ae4-4988-ab0e-b2db82ec7b87 req-e6aad1fa-f7a1-47d8-a233-03b029772b50 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updated VIF entry in instance network info cache for port c7ad19f5-97e6-431b-bd8f-4a769804e27f. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG nova.network.neutron [req-dafe35e6-8ae4-4988-ab0e-b2db82ec7b87 req-e6aad1fa-f7a1-47d8-a233-03b029772b50 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updating instance_info_cache with network_info: [{"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:04:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-dafe35e6-8ae4-4988-ab0e-b2db82ec7b87 req-e6aad1fa-f7a1-47d8-a233-03b029772b50 service nova] Releasing lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:04:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-07477b5b-b823-4edf-bc38-93e9565d15e4 req-414cfe21-a8b5-417a-aa4b-2a71706cce73 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received event network-vif-plugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:04:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-07477b5b-b823-4edf-bc38-93e9565d15e4 req-414cfe21-a8b5-417a-aa4b-2a71706cce73 service nova] Acquiring lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-07477b5b-b823-4edf-bc38-93e9565d15e4 req-414cfe21-a8b5-417a-aa4b-2a71706cce73 service nova] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-07477b5b-b823-4edf-bc38-93e9565d15e4 req-414cfe21-a8b5-417a-aa4b-2a71706cce73 service nova] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-07477b5b-b823-4edf-bc38-93e9565d15e4 req-414cfe21-a8b5-417a-aa4b-2a71706cce73 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] No waiting events found dispatching network-vif-plugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:04:38 user nova-compute[70914]: WARNING nova.compute.manager [req-07477b5b-b823-4edf-bc38-93e9565d15e4 req-414cfe21-a8b5-417a-aa4b-2a71706cce73 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received unexpected event network-vif-plugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f for instance with vm_state building and task_state spawning.
Jul 27 14:04:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466679.8965816, 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:04:39 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] VM Resumed (Lifecycle Event)
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 14:04:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Instance spawned successfully.
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:04:39 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466679.897961, 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:04:39 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] VM Started (Lifecycle Event)
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:04:39 user nova-compute[70914]: INFO nova.compute.manager [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Took 7.11 seconds to spawn the instance on the hypervisor.
Jul 27 14:04:39 user nova-compute[70914]: DEBUG nova.compute.manager [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:04:40 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:04:40 user nova-compute[70914]: INFO nova.compute.manager [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Took 7.72 seconds to build instance.
Jul 27 14:04:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-51ceca3e-3994-40b6-8f47-b5082c7a23aa req-af2a1423-8d58-41fb-a913-cae26815b67d service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received event network-vif-plugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:04:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-51ceca3e-3994-40b6-8f47-b5082c7a23aa req-af2a1423-8d58-41fb-a913-cae26815b67d service nova] Acquiring lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:04:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-51ceca3e-3994-40b6-8f47-b5082c7a23aa req-af2a1423-8d58-41fb-a913-cae26815b67d service nova] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:04:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-51ceca3e-3994-40b6-8f47-b5082c7a23aa req-af2a1423-8d58-41fb-a913-cae26815b67d service nova] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-51ceca3e-3994-40b6-8f47-b5082c7a23aa req-af2a1423-8d58-41fb-a913-cae26815b67d service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] No waiting events found dispatching network-vif-plugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:04:40 user nova-compute[70914]: WARNING nova.compute.manager [req-51ceca3e-3994-40b6-8f47-b5082c7a23aa req-af2a1423-8d58-41fb-a913-cae26815b67d service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received unexpected event network-vif-plugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f for instance with vm_state active and task_state None.
Jul 27 14:04:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-3c13193d-4daf-4609-bfe4-99a3faa8c965 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.819s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:04:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:04:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:04:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:04:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:04:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:04:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:04:58 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:04:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:00 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:05:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:00 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:00 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:05:00 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:05:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:00 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:05:01 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:05:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8428MB free_disk=25.172359466552734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance b940e113-545b-402a-a926-4425a36e2649 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:05:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:04 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:05:05 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:05:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:07 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:05:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:05:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:05:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:05:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 14:05:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:05:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:05:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:05:09 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 60d35122-55c4-458e-bf51-db6d2a87b1d1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:05:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:10 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updating instance_info_cache with network_info: [{"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:05:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:05:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:05:10 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:05:10 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:05:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:11 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:05:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "e1bba032-0641-430d-beee-77d4268cf47e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 14:05:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:11 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 14:05:11 user nova-compute[70914]: INFO nova.compute.claims [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Claim successful on node user
Jul 27 14:05:12 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 14:05:12 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 14:05:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG nova.policy [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39c9278ea5d24d2a9182c20bcb32febb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8032e7912884d3bb9a66632f95137ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 14:05:12 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Creating image(s)
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "/opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "/opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk 1073741824" returned: 0 in 0.050s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:12 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Successfully created port: 7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Cannot resize image /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'migration_context' on Instance uuid e1bba032-0641-430d-beee-77d4268cf47e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Ensure instance console log exists: /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Successfully updated port: 7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "refresh_cache-e1bba032-0641-430d-beee-77d4268cf47e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquired lock "refresh_cache-e1bba032-0641-430d-beee-77d4268cf47e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 14:05:13 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-c5dc9326-23ed-410b-b4af-0283ff8ba2bd req-ea880c44-393a-46ad-8ba6-de17dafdf157 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received event network-changed-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.compute.manager [req-c5dc9326-23ed-410b-b4af-0283ff8ba2bd req-ea880c44-393a-46ad-8ba6-de17dafdf157 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Refreshing instance network info cache due to event network-changed-7a46b1a7-43c3-473d-b360-5e6fddf56ae9. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c5dc9326-23ed-410b-b4af-0283ff8ba2bd req-ea880c44-393a-46ad-8ba6-de17dafdf157 service nova] Acquiring lock "refresh_cache-e1bba032-0641-430d-beee-77d4268cf47e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Updating instance_info_cache with network_info: [{"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Releasing lock "refresh_cache-e1bba032-0641-430d-beee-77d4268cf47e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Instance network_info: |[{"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c5dc9326-23ed-410b-b4af-0283ff8ba2bd req-ea880c44-393a-46ad-8ba6-de17dafdf157 service nova] Acquired lock "refresh_cache-e1bba032-0641-430d-beee-77d4268cf47e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.network.neutron [req-c5dc9326-23ed-410b-b4af-0283ff8ba2bd req-ea880c44-393a-46ad-8ba6-de17dafdf157 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Refreshing network info cache for port 7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Start _get_guest_xml network_info=[{"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 14:05:14 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:05:14 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1154378852',display_name='tempest-AttachVolumeNegativeTest-server-1154378852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1154378852',id=48,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDprrpn/RO2ExIhAIL1k/JserykIAE4alEEODJ4ocMVngCQAApanXk7q7BdLsCn3GB6bpkF3rhwUmAvwLCs9NEgEyY9GZgJuGlGQZj2kLuZrHEK3hFwxevF3W8NOEffVsQ==',key_name='tempest-keypair-1108767487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-3q99fsld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=e1bba032-0641-430d-beee-77d4268cf47e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:65:76,bridge_name='br-int',has_traffic_filtering=True,id=7a46b1a7-43c3-473d-b360-5e6fddf56ae9,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a46b1a7-43') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'pci_devices' on Instance uuid e1bba032-0641-430d-beee-77d4268cf47e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] End _get_guest_xml xml=<domain type="kvm">
Jul 27 14:05:14 user nova-compute[70914]:   <uuid>e1bba032-0641-430d-beee-77d4268cf47e</uuid>
Jul 27 14:05:14 user nova-compute[70914]:   <name>instance-00000030</name>
Jul 27 14:05:14 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 14:05:14 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 14:05:14 user nova-compute[70914]:   <metadata>
Jul 27 14:05:14 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 14:05:14 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 14:05:14 user nova-compute[70914]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1154378852</nova:name>
Jul 27 14:05:14 user nova-compute[70914]:       <nova:creationTime>2023-07-27 14:05:14</nova:creationTime>
Jul 27 14:05:14 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 14:05:14 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 14:05:14 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 14:05:14 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 14:05:14 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 14:05:14 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 14:05:14 user nova-compute[70914]:       </nova:flavor>
Jul 27 14:05:14 user nova-compute[70914]:       <nova:owner>
Jul 27 14:05:14 user nova-compute[70914]:         <nova:user uuid="39c9278ea5d24d2a9182c20bcb32febb">tempest-AttachVolumeNegativeTest-431364948-project-member</nova:user>
Jul 27 14:05:14 user nova-compute[70914]:         <nova:project uuid="f8032e7912884d3bb9a66632f95137ad">tempest-AttachVolumeNegativeTest-431364948</nova:project>
Jul 27 14:05:14 user nova-compute[70914]:       </nova:owner>
Jul 27 14:05:14 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 14:05:14 user nova-compute[70914]:       <nova:ports>
Jul 27 14:05:14 user nova-compute[70914]:         <nova:port uuid="7a46b1a7-43c3-473d-b360-5e6fddf56ae9">
Jul 27 14:05:14 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 14:05:14 user nova-compute[70914]:         </nova:port>
Jul 27 14:05:14 user nova-compute[70914]:       </nova:ports>
Jul 27 14:05:14 user nova-compute[70914]:     </nova:instance>
Jul 27 14:05:14 user nova-compute[70914]:   </metadata>
Jul 27 14:05:14 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 14:05:14 user nova-compute[70914]:     <system>
Jul 27 14:05:14 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 14:05:14 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 14:05:14 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 14:05:14 user nova-compute[70914]:       <entry name="serial">e1bba032-0641-430d-beee-77d4268cf47e</entry>
Jul 27 14:05:14 user nova-compute[70914]:       <entry name="uuid">e1bba032-0641-430d-beee-77d4268cf47e</entry>
Jul 27 14:05:14 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 14:05:14 user nova-compute[70914]:     </system>
Jul 27 14:05:14 user nova-compute[70914]:   </sysinfo>
Jul 27 14:05:14 user nova-compute[70914]:   <os>
Jul 27 14:05:14 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 14:05:14 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 14:05:14 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 14:05:14 user nova-compute[70914]:   </os>
Jul 27 14:05:14 user nova-compute[70914]:   <features>
Jul 27 14:05:14 user nova-compute[70914]:     <acpi/>
Jul 27 14:05:14 user nova-compute[70914]:     <apic/>
Jul 27 14:05:14 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 14:05:14 user nova-compute[70914]:   </features>
Jul 27 14:05:14 user nova-compute[70914]:   <clock offset="utc">
Jul 27 14:05:14 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 14:05:14 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 14:05:14 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 14:05:14 user nova-compute[70914]:   </clock>
Jul 27 14:05:14 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 14:05:14 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 14:05:14 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 14:05:14 user nova-compute[70914]:   </cpu>
Jul 27 14:05:14 user nova-compute[70914]:   <devices>
Jul 27 14:05:14 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 14:05:14 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 14:05:14 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk"/>
Jul 27 14:05:14 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 14:05:14 user nova-compute[70914]:     </disk>
Jul 27 14:05:14 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 14:05:14 user nova-compute[70914]:       <mac address="fa:16:3e:f1:65:76"/>
Jul 27 14:05:14 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:05:14 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 14:05:14 user nova-compute[70914]:       <target dev="tap7a46b1a7-43"/>
Jul 27 14:05:14 user nova-compute[70914]:     </interface>
Jul 27 14:05:14 user nova-compute[70914]:     <serial type="pty">
Jul 27 14:05:14 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/console.log" append="off"/>
Jul 27 14:05:14 user nova-compute[70914]:     </serial>
Jul 27 14:05:14 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 14:05:14 user nova-compute[70914]:     <video>
Jul 27 14:05:14 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:05:14 user nova-compute[70914]:     </video>
Jul 27 14:05:14 user nova-compute[70914]:     <rng model="virtio">
Jul 27 14:05:14 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 14:05:14 user nova-compute[70914]:     </rng>
Jul 27 14:05:14 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 14:05:14 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 14:05:14 user nova-compute[70914]:       <stats period="10"/>
Jul 27 14:05:14 user nova-compute[70914]:     </memballoon>
Jul 27 14:05:14 user nova-compute[70914]:   </devices>
Jul 27 14:05:14 user nova-compute[70914]: </domain>
Jul 27 14:05:14 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1154378852',display_name='tempest-AttachVolumeNegativeTest-server-1154378852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1154378852',id=48,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDprrpn/RO2ExIhAIL1k/JserykIAE4alEEODJ4ocMVngCQAApanXk7q7BdLsCn3GB6bpkF3rhwUmAvwLCs9NEgEyY9GZgJuGlGQZj2kLuZrHEK3hFwxevF3W8NOEffVsQ==',key_name='tempest-keypair-1108767487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-3q99fsld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=e1bba032-0641-430d-beee-77d4268cf47e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:65:76,bridge_name='br-int',has_traffic_filtering=True,id=7a46b1a7-43c3-473d-b360-5e6fddf56ae9,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a46b1a7-43') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG os_vif [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:65:76,bridge_name='br-int',has_traffic_filtering=True,id=7a46b1a7-43c3-473d-b360-5e6fddf56ae9,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a46b1a7-43') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a46b1a7-43, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a46b1a7-43, col_values=(('external_ids', {'iface-id': '7a46b1a7-43c3-473d-b360-5e6fddf56ae9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:65:76', 'vm-uuid': 'e1bba032-0641-430d-beee-77d4268cf47e'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:14 user nova-compute[70914]: INFO os_vif [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:65:76,bridge_name='br-int',has_traffic_filtering=True,id=7a46b1a7-43c3-473d-b360-5e6fddf56ae9,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a46b1a7-43')
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No VIF found with MAC fa:16:3e:f1:65:76, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.network.neutron [req-c5dc9326-23ed-410b-b4af-0283ff8ba2bd req-ea880c44-393a-46ad-8ba6-de17dafdf157 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Updated VIF entry in instance network info cache for port 7a46b1a7-43c3-473d-b360-5e6fddf56ae9. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG nova.network.neutron [req-c5dc9326-23ed-410b-b4af-0283ff8ba2bd req-ea880c44-393a-46ad-8ba6-de17dafdf157 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Updating instance_info_cache with network_info: [{"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:05:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c5dc9326-23ed-410b-b4af-0283ff8ba2bd req-ea880c44-393a-46ad-8ba6-de17dafdf157 service nova] Releasing lock "refresh_cache-e1bba032-0641-430d-beee-77d4268cf47e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:05:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:15 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:16 user nova-compute[70914]: DEBUG nova.compute.manager [req-bd42d797-de12-4f05-ab71-4830b0adb3ac req-8c8c1e9f-2a02-412f-a7b7-2be663c4b1f6 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received event network-vif-plugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:05:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bd42d797-de12-4f05-ab71-4830b0adb3ac req-8c8c1e9f-2a02-412f-a7b7-2be663c4b1f6 service nova] Acquiring lock "e1bba032-0641-430d-beee-77d4268cf47e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bd42d797-de12-4f05-ab71-4830b0adb3ac req-8c8c1e9f-2a02-412f-a7b7-2be663c4b1f6 service nova] Lock "e1bba032-0641-430d-beee-77d4268cf47e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bd42d797-de12-4f05-ab71-4830b0adb3ac req-8c8c1e9f-2a02-412f-a7b7-2be663c4b1f6 service nova] Lock "e1bba032-0641-430d-beee-77d4268cf47e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:16 user nova-compute[70914]: DEBUG nova.compute.manager [req-bd42d797-de12-4f05-ab71-4830b0adb3ac req-8c8c1e9f-2a02-412f-a7b7-2be663c4b1f6 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] No waiting events found dispatching network-vif-plugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:05:16 user nova-compute[70914]: WARNING nova.compute.manager [req-bd42d797-de12-4f05-ab71-4830b0adb3ac req-8c8c1e9f-2a02-412f-a7b7-2be663c4b1f6 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received unexpected event network-vif-plugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 for instance with vm_state building and task_state spawning.
Jul 27 14:05:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466717.774334, e1bba032-0641-430d-beee-77d4268cf47e => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:05:17 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e1bba032-0641-430d-beee-77d4268cf47e] VM Resumed (Lifecycle Event)
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 14:05:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Instance spawned successfully.
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:05:17 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e1bba032-0641-430d-beee-77d4268cf47e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466717.776969, e1bba032-0641-430d-beee-77d4268cf47e => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:05:17 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e1bba032-0641-430d-beee-77d4268cf47e] VM Started (Lifecycle Event)
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:05:17 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: e1bba032-0641-430d-beee-77d4268cf47e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:05:17 user nova-compute[70914]: INFO nova.compute.manager [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Took 5.36 seconds to spawn the instance on the hypervisor.
Jul 27 14:05:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:05:17 user nova-compute[70914]: INFO nova.compute.manager [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Took 6.00 seconds to build instance.
Jul 27 14:05:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a120cd0b-e470-4793-bb4e-11425d8665ea tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.100s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-51e1be8f-168f-4fce-9df2-58e8a02ac1a1 req-cbc053c3-0ecf-46da-a582-e53cde0dabad service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received event network-vif-plugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:05:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-51e1be8f-168f-4fce-9df2-58e8a02ac1a1 req-cbc053c3-0ecf-46da-a582-e53cde0dabad service nova] Acquiring lock "e1bba032-0641-430d-beee-77d4268cf47e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-51e1be8f-168f-4fce-9df2-58e8a02ac1a1 req-cbc053c3-0ecf-46da-a582-e53cde0dabad service nova] Lock "e1bba032-0641-430d-beee-77d4268cf47e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-51e1be8f-168f-4fce-9df2-58e8a02ac1a1 req-cbc053c3-0ecf-46da-a582-e53cde0dabad service nova] Lock "e1bba032-0641-430d-beee-77d4268cf47e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:18 user nova-compute[70914]: DEBUG nova.compute.manager [req-51e1be8f-168f-4fce-9df2-58e8a02ac1a1 req-cbc053c3-0ecf-46da-a582-e53cde0dabad service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] No waiting events found dispatching network-vif-plugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:05:18 user nova-compute[70914]: WARNING nova.compute.manager [req-51e1be8f-168f-4fce-9df2-58e8a02ac1a1 req-cbc053c3-0ecf-46da-a582-e53cde0dabad service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received unexpected event network-vif-plugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 for instance with vm_state active and task_state None.
Jul 27 14:05:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:05:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:05:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:05:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:05:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:05:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:05:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-cc716554-07ea-4025-85ca-70053635532d req-4a0a65a4-2a26-47af-b093-3bfed90351ee service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received event network-changed-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG nova.compute.manager [req-cc716554-07ea-4025-85ca-70053635532d req-4a0a65a4-2a26-47af-b093-3bfed90351ee service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Refreshing instance network info cache due to event network-changed-01996231-68c0-422f-af34-34c33bef42f2. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cc716554-07ea-4025-85ca-70053635532d req-4a0a65a4-2a26-47af-b093-3bfed90351ee service nova] Acquiring lock "refresh_cache-b940e113-545b-402a-a926-4425a36e2649" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cc716554-07ea-4025-85ca-70053635532d req-4a0a65a4-2a26-47af-b093-3bfed90351ee service nova] Acquired lock "refresh_cache-b940e113-545b-402a-a926-4425a36e2649" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-cc716554-07ea-4025-85ca-70053635532d req-4a0a65a4-2a26-47af-b093-3bfed90351ee service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Refreshing network info cache for port 01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "b940e113-545b-402a-a926-4425a36e2649" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "b940e113-545b-402a-a926-4425a36e2649" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "b940e113-545b-402a-a926-4425a36e2649-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "b940e113-545b-402a-a926-4425a36e2649-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "b940e113-545b-402a-a926-4425a36e2649-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:46 user nova-compute[70914]: INFO nova.compute.manager [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Terminating instance
Jul 27 14:05:46 user nova-compute[70914]: DEBUG nova.compute.manager [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-cc716554-07ea-4025-85ca-70053635532d req-4a0a65a4-2a26-47af-b093-3bfed90351ee service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Updated VIF entry in instance network info cache for port 01996231-68c0-422f-af34-34c33bef42f2. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-cc716554-07ea-4025-85ca-70053635532d req-4a0a65a4-2a26-47af-b093-3bfed90351ee service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Updating instance_info_cache with network_info: [{"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cc716554-07ea-4025-85ca-70053635532d req-4a0a65a4-2a26-47af-b093-3bfed90351ee service nova] Releasing lock "refresh_cache-b940e113-545b-402a-a926-4425a36e2649" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:47 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: b940e113-545b-402a-a926-4425a36e2649] Instance destroyed successfully.
Jul 27 14:05:47 user nova-compute[70914]: DEBUG nova.objects.instance [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'resources' on Instance uuid b940e113-545b-402a-a926-4425a36e2649 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-908783433',display_name='tempest-TestVolumeBootPattern-server-908783433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-908783433',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTIlETEzrlhBz6OePq01eKR0vcasXvXhxqFCkGLx2Csd5vC2HyUqXiG76OOALVAFV1uvdeTYYEQFTuaa0BMfwlQOyATH6cj50OJFdi8LwK7LlbSEfvUgqiY4m0oMQIcqg==',key_name='tempest-TestVolumeBootPattern-1266066309',keypairs=<?>,launch_index=0,launched_at=2023-07-27T14:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-rytxlcby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T14:04:05Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=b940e113-545b-402a-a926-4425a36e2649,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "01996231-68c0-422f-af34-34c33bef42f2", "address": "fa:16:3e:61:5a:78", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01996231-68", "ovs_interfaceid": "01996231-68c0-422f-af34-34c33bef42f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5a:78,bridge_name='br-int',has_traffic_filtering=True,id=01996231-68c0-422f-af34-34c33bef42f2,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01996231-68') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_vif [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5a:78,bridge_name='br-int',has_traffic_filtering=True,id=01996231-68c0-422f-af34-34c33bef42f2,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01996231-68') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01996231-68, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:05:47 user nova-compute[70914]: INFO os_vif [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5a:78,bridge_name='br-int',has_traffic_filtering=True,id=01996231-68c0-422f-af34-34c33bef42f2,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01996231-68')
Jul 27 14:05:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOSsjWMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:05:47 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf87fb2c-4bc6-4296-bb18-a831df1ac2e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:05:47 user nova-compute[70914]: No targets found.
Jul 27 14:05:47 user nova-compute[70914]: iSNS:
Jul 27 14:05:47 user nova-compute[70914]: No targets found.
Jul 27 14:05:47 user nova-compute[70914]: STATIC:
Jul 27 14:05:47 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2
Jul 27 14:05:47 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:05:47 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:05:47 user nova-compute[70914]: FIRMWARE:
Jul 27 14:05:47 user nova-compute[70914]: No targets found.
Jul 27 14:05:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:05:47 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:05:47 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a64e1a-181f-4410-86e8-02ed3bdb1d45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[124e2836-db48-4782-870a-63b6fa88310d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:05:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:05:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c18401510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c946b148-d8c1-4bf6-aa2a-16b8e3d73c7a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e9343b-57c9-40b1-9c4c-a77070bda191]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acaa5e1-771a-4c3d-bd78-5829be023345]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb10850-3dfd-4269-ba86-e8aaa49a2a4b]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b1379572', '/dev/disk/by-id/scsi-23239333939393136', '/dev/disk/by-id/scsi-1SCST_BIOb1379572-2939991605889c49') {{(pid=82182) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2998134-5801-490c-9715-28d47205b76f]: (4, None) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e929281-12c4-4474-b24a-d2fa7fc4bbc6]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[629490b5-197a-47ce-9b54-59354e2f3886]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260]
Jul 27 14:05:47 user nova-compute[70914]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260] successful.
Jul 27 14:05:47 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2127fd29-7c0c-4aef-ba5f-ffab5359050b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== disconnect_volume: return (306ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:05:47 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Deleting instance files /opt/stack/data/nova/instances/b940e113-545b-402a-a926-4425a36e2649_del
Jul 27 14:05:47 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Deletion of /opt/stack/data/nova/instances/b940e113-545b-402a-a926-4425a36e2649_del complete
Jul 27 14:05:47 user nova-compute[70914]: INFO nova.compute.manager [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 27 14:05:47 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: b940e113-545b-402a-a926-4425a36e2649] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:05:47 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: b940e113-545b-402a-a926-4425a36e2649] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received event network-vif-unplugged-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] Acquiring lock "b940e113-545b-402a-a926-4425a36e2649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] Lock "b940e113-545b-402a-a926-4425a36e2649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] Lock "b940e113-545b-402a-a926-4425a36e2649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] No waiting events found dispatching network-vif-unplugged-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received event network-vif-unplugged-01996231-68c0-422f-af34-34c33bef42f2 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received event network-vif-plugged-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] Acquiring lock "b940e113-545b-402a-a926-4425a36e2649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] Lock "b940e113-545b-402a-a926-4425a36e2649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] Lock "b940e113-545b-402a-a926-4425a36e2649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] No waiting events found dispatching network-vif-plugged-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:05:48 user nova-compute[70914]: WARNING nova.compute.manager [req-4f341f9c-d63e-4578-8e1e-dac02bd0a0b3 req-6f86c80a-4431-4014-975b-c8fea2f30f81 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received unexpected event network-vif-plugged-01996231-68c0-422f-af34-34c33bef42f2 for instance with vm_state active and task_state deleting.
Jul 27 14:05:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: b940e113-545b-402a-a926-4425a36e2649] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:05:48 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: b940e113-545b-402a-a926-4425a36e2649] Took 0.80 seconds to deallocate network for instance.
Jul 27 14:05:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-8fd33fcb-1a0f-42a5-8a09-409f5a80a451 req-a448cd1c-22fd-4b58-aeaa-f31e6c3e7647 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Received event network-vif-deleted-01996231-68c0-422f-af34-34c33bef42f2 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:05:48 user nova-compute[70914]: INFO nova.compute.manager [req-8fd33fcb-1a0f-42a5-8a09-409f5a80a451 req-a448cd1c-22fd-4b58-aeaa-f31e6c3e7647 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Neutron deleted interface 01996231-68c0-422f-af34-34c33bef42f2; detaching it from the instance and deleting it from the info cache
Jul 27 14:05:48 user nova-compute[70914]: DEBUG nova.network.neutron [req-8fd33fcb-1a0f-42a5-8a09-409f5a80a451 req-a448cd1c-22fd-4b58-aeaa-f31e6c3e7647 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:05:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-8fd33fcb-1a0f-42a5-8a09-409f5a80a451 req-a448cd1c-22fd-4b58-aeaa-f31e6c3e7647 service nova] [instance: b940e113-545b-402a-a926-4425a36e2649] Detach interface failed, port_id=01996231-68c0-422f-af34-34c33bef42f2, reason: Instance b940e113-545b-402a-a926-4425a36e2649 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 14:05:49 user nova-compute[70914]: INFO nova.compute.manager [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: b940e113-545b-402a-a926-4425a36e2649] Took 0.91 seconds to detach 1 volumes for instance.
Jul 27 14:05:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:05:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:05:49 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:05:49 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:05:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:49 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Deleted allocations for instance b940e113-545b-402a-a926-4425a36e2649
Jul 27 14:05:49 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-6e0b338b-2c85-4f13-8987-252198802651 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "b940e113-545b-402a-a926-4425a36e2649" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.261s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:05:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:05:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:05:58 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:06:01 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:06:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:06:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:06:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:06:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:06:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:02 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466747.2290578, b940e113-545b-402a-a926-4425a36e2649 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:06:02 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: b940e113-545b-402a-a926-4425a36e2649] VM Stopped (Lifecycle Event)
Jul 27 14:06:02 user nova-compute[70914]: DEBUG nova.compute.manager [None req-594bc1d9-58bf-4259-a62d-410cc4778207 None None] [instance: b940e113-545b-402a-a926-4425a36e2649] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:06:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:03 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:06:03 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:06:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8443MB free_disk=25.134098052978516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e1bba032-0641-430d-beee-77d4268cf47e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:06:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:06:06 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:06:06 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:06:06 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:06:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:06:07 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:06:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:06:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:06:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:06:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:06:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:06:09 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:06:10 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updating instance_info_cache with network_info: [{"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:06:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:06:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:06:11 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:06:11 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:06:11 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:06:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:06:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:06:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:06:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:06:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:06:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:06:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-9eb49031-0cc8-4580-96c3-aeefd9a6dcb1 req-77b7f683-29ae-4a18-b294-12d1dc883b83 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received event network-changed-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG nova.compute.manager [req-9eb49031-0cc8-4580-96c3-aeefd9a6dcb1 req-77b7f683-29ae-4a18-b294-12d1dc883b83 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Refreshing instance network info cache due to event network-changed-c7ad19f5-97e6-431b-bd8f-4a769804e27f. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9eb49031-0cc8-4580-96c3-aeefd9a6dcb1 req-77b7f683-29ae-4a18-b294-12d1dc883b83 service nova] Acquiring lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9eb49031-0cc8-4580-96c3-aeefd9a6dcb1 req-77b7f683-29ae-4a18-b294-12d1dc883b83 service nova] Acquired lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG nova.network.neutron [req-9eb49031-0cc8-4580-96c3-aeefd9a6dcb1 req-77b7f683-29ae-4a18-b294-12d1dc883b83 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Refreshing network info cache for port c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'flavor' on Instance uuid 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:06:24 user nova-compute[70914]: INFO nova.compute.manager [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Attaching volume 00c8425f-22a4-407e-9547-0961ef7b4904 to /dev/vdb
Jul 27 14:06:24 user nova-compute[70914]: DEBUG nova.network.neutron [req-9eb49031-0cc8-4580-96c3-aeefd9a6dcb1 req-77b7f683-29ae-4a18-b294-12d1dc883b83 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updated VIF entry in instance network info cache for port c7ad19f5-97e6-431b-bd8f-4a769804e27f. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG nova.network.neutron [req-9eb49031-0cc8-4580-96c3-aeefd9a6dcb1 req-77b7f683-29ae-4a18-b294-12d1dc883b83 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updating instance_info_cache with network_info: [{"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-9eb49031-0cc8-4580-96c3-aeefd9a6dcb1 req-77b7f683-29ae-4a18-b294-12d1dc883b83 service nova] Releasing lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG os_brick.utils [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:06:24 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92cd6b6-b2df-4181-a66e-dd58616bf6d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d6d8bf-78c6-496a-8a2f-f85aafb4803f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be9b7ef-ace5-4002-a27c-4647e6f8eb97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcca86b-5440-499c-82d6-fa3851e0165c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:06:25 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 14:06:25 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4110f1-81a3-422b-aa24-3b4932e8e9be]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG os_brick.utils [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:06:25 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updating existing volume attachment record: 26815910-b03d-4962-94ad-248880f93f1d {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 14:06:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiWyHjCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:06:31 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:06:31 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:06:31 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc0eb80-b0fa-45a6-be47-5f2527110474]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 14:06:31 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7eda69-c4d2-4237-bb85-1909b1b74b6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904] added
Jul 27 14:06:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67f4f86-8bb6-4c32-b53b-263c26b44c2d]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[44593bb0-bde1-4e63-a8c4-9e621b5ec0ee]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XiWyHjCh {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XiWyHjCh" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[600150a9-bf3a-4d34-a976-fcf52a8c732f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XiWyHjCh'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d1dadf-e3f6-4cce-903b-e0aa57e26f11]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4973e99b-e7d8-44f4-b9cd-2156d3e89ab9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 14:06:31 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 14:06:31 user nova-compute[70914]:  {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:06:31 user nova-compute[70914]: WARNING os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 14:06:31 user nova-compute[70914]: 
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1531081b-01b8-49ec-afe4-0913c8b5d95f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904, portal: 172.16.0.220,3260]
Jul 27 14:06:31 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904, portal: 172.16.0.220,3260] successful.
Jul 27 14:06:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6938fbf7-7e5f-46b0-9918-1e03f7008d8a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[37023ff8-c3ee-4666-ae73-f9d07e689164]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 (non-flash)
Jul 27 14:06:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 (non-flash)
Jul 27 14:06:31 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa0d5c4-5d4a-498b-92e9-fe2af5e3ddc2]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:31 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:06:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:32 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:06:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiWyHjCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 14:06:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:06:32 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23335366336323666', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:06:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335366336323666', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 14:06:33 user nova-compute[70914]: DEBUG nova.objects.instance [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'flavor' on Instance uuid 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:06:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 14:06:33 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:06:33 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 14:06:33 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:06:33 user nova-compute[70914]:   <serial>00c8425f-22a4-407e-9547-0961ef7b4904</serial>
Jul 27 14:06:33 user nova-compute[70914]: </disk>
Jul 27 14:06:33 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 14:06:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:06:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:06:33 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] No VIF found with MAC fa:16:3e:57:17:18, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:06:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-d70ff03e-801e-49cc-9ea9-6a1f3111ebc7 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.630s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:06:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:06:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:06:35 user nova-compute[70914]: INFO nova.compute.manager [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Detaching volume 00c8425f-22a4-407e-9547-0961ef7b4904
Jul 27 14:06:35 user nova-compute[70914]: INFO nova.virt.block_device [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Attempting to driver detach volume 00c8425f-22a4-407e-9547-0961ef7b4904 from mountpoint /dev/vdb
Jul 27 14:06:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Attempting to detach device vdb from instance 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 14:06:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:06:35 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:06:35 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 14:06:35 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:06:35 user nova-compute[70914]:   <serial>00c8425f-22a4-407e-9547-0961ef7b4904</serial>
Jul 27 14:06:35 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 14:06:35 user nova-compute[70914]: </disk>
Jul 27 14:06:35 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:06:35 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Successfully detached device vdb from instance 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f from the persistent domain config.
Jul 27 14:06:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 14:06:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:06:35 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:06:35 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 14:06:35 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:06:35 user nova-compute[70914]:   <serial>00c8425f-22a4-407e-9547-0961ef7b4904</serial>
Jul 27 14:06:35 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 14:06:35 user nova-compute[70914]: </disk>
Jul 27 14:06:35 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690466796.1985815, 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 14:06:36 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Successfully detached device vdb from instance 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f from the live domain config.
Jul 27 14:06:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiWyHjCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:06:36 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce02861-0185-4e85-b1c9-827773879654]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:06:36 user nova-compute[70914]: No targets found.
Jul 27 14:06:36 user nova-compute[70914]: iSNS:
Jul 27 14:06:36 user nova-compute[70914]: No targets found.
Jul 27 14:06:36 user nova-compute[70914]: STATIC:
Jul 27 14:06:36 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904
Jul 27 14:06:36 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:06:36 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:06:36 user nova-compute[70914]: FIRMWARE:
Jul 27 14:06:36 user nova-compute[70914]: No targets found.
Jul 27 14:06:36 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:06:36 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:06:36 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebacd01-536b-4aee-8357-03f90ccbd9d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3bb84d-644c-4366-9c6e-b16093fa7213]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 (non-flash)
Jul 27 14:06:36 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 (non-flash)
Jul 27 14:06:36 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c187b7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6df500-3d81-465f-b8fd-6796840edf77]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89e5b5a-8822-405f-b3f3-c4db92ec7d29]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f917ec1d-b308-4964-a026-8c0869b42e75]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f08f363-370a-4160-8f69-c5c14ad9c682]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[da981276-5c1d-497d-be4d-bcbdf2699dee]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a5dec7-9e40-4d19-a5be-98b4f522f134]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904, portal: 172.16.0.220,3260]
Jul 27 14:06:36 user nova-compute[70914]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904, portal: 172.16.0.220,3260] successful.
Jul 27 14:06:36 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c8425f-22a4-407e-9547-0961ef7b4904 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b3e97c-e27d-48af-bece-b0a6cbbe6547]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] <== disconnect_volume: return (298ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:06:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:06:37 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'flavor' on Instance uuid 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:06:37 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c2fc90fd-16b0-43ee-9b46-e4f769dd4aa9 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.591s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:06:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "6b79f962-6eec-411d-8b07-af448df4a52f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "6b79f962-6eec-411d-8b07-af448df4a52f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 14:06:38 user nova-compute[70914]: INFO nova.compute.claims [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Claim successful on node user
Jul 27 14:06:38 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 14:06:38 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 14:06:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 14:06:38 user nova-compute[70914]: INFO nova.virt.block_device [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Booting with volume fe1270a3-c982-4904-98e9-c5140f6241a2 at /dev/vda
Jul 27 14:06:38 user nova-compute[70914]: DEBUG nova.policy [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6161b1cf5fb4d08a8cbd36a93b8400c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ac071233d44fbb62e558725f63ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG os_brick.utils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c06a73-300f-44fa-a45e-8f303e29795b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e2adc1-c8b7-4129-9fff-639624af4aeb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d137fec-2b02-4b17-be11-b2cbc76815d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19a3a3e-42aa-40d1-b672-55939fb13b62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:06:38 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 14:06:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aa8ec1-d76e-4329-be24-3e981dde7efc]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG os_brick.utils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:06:38 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updating existing volume attachment record: 92e9f9ee-d4c5-49ab-81c3-3a4c5125f535 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 14:06:39 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Successfully created port: fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 14:06:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Successfully updated port: fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquired lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-99d7b581-960d-425f-81bc-846b68c46718 req-63c5e2a4-b50c-448a-99d5-7591ed918094 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received event network-changed-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-99d7b581-960d-425f-81bc-846b68c46718 req-63c5e2a4-b50c-448a-99d5-7591ed918094 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Refreshing instance network info cache due to event network-changed-fefd93d8-5647-4359-b062-af773a1b1855. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-99d7b581-960d-425f-81bc-846b68c46718 req-63c5e2a4-b50c-448a-99d5-7591ed918094 service nova] Acquiring lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG nova.network.neutron [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updating instance_info_cache with network_info: [{"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Releasing lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Instance network_info: |[{"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-99d7b581-960d-425f-81bc-846b68c46718 req-63c5e2a4-b50c-448a-99d5-7591ed918094 service nova] Acquired lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:06:40 user nova-compute[70914]: DEBUG nova.network.neutron [req-99d7b581-960d-425f-81bc-846b68c46718 req-63c5e2a4-b50c-448a-99d5-7591ed918094 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Refreshing network info cache for port fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:06:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-99d7b581-960d-425f-81bc-846b68c46718 req-63c5e2a4-b50c-448a-99d5-7591ed918094 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updated VIF entry in instance network info cache for port fefd93d8-5647-4359-b062-af773a1b1855. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:06:41 user nova-compute[70914]: DEBUG nova.network.neutron [req-99d7b581-960d-425f-81bc-846b68c46718 req-63c5e2a4-b50c-448a-99d5-7591ed918094 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updating instance_info_cache with network_info: [{"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:06:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-99d7b581-960d-425f-81bc-846b68c46718 req-63c5e2a4-b50c-448a-99d5-7591ed918094 service nova] Releasing lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:06:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 14:06:45 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Creating image(s)
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Ensure instance console log exists: /opt/stack/data/nova/instances/6b79f962-6eec-411d-8b07-af448df4a52f/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Start _get_guest_xml network_info=[{"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '92e9f9ee-d4c5-49ab-81c3-3a4c5125f535', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOSsjWMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b79f962-6eec-411d-8b07-af448df4a52f', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe1270a3-c982-4904-98e9-c5140f6241a2', 'serial': 'fe1270a3-c982-4904-98e9-c5140f6241a2'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 14:06:45 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:06:45 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOSsjWMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:06:45 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:06:45 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:06:45 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ecc360-4aaf-4ed4-9321-221d07f002ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 14:06:45 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[751b87d2-7369-40ef-947b-adacacbf2e25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2] added
Jul 27 14:06:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf93833-8f35-4b63-88cb-37b6e5734d5e]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5829dba-6e5a-4bd1-a2a6-92d9141844b4]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JOSsjWMp {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JOSsjWMp" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde87691-b12e-4a23-8b17-695d840d705f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JOSsjWMp'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ef6cb6-868e-464d-9a81-795a78caf937]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a343ec8-b393-4cb0-bf57-fd3cf4641f98]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 14:06:46 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 14:06:46 user nova-compute[70914]:  {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:06:46 user nova-compute[70914]: WARNING os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 14:06:46 user nova-compute[70914]: 
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94571ea-9563-4a44-b732-d0f87b0a247e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260]
Jul 27 14:06:46 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260] successful.
Jul 27 14:06:46 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab0cd8c-8ce0-4df3-bb4c-394891f0b4e3]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d0c48f-a5e6-4eef-bb92-3e44dad0cc84]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:06:46 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:06:46 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f2884c-9392-4e69-b90a-cd741333599b]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:06:46 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOSsjWMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23239333939393136', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239333939393136', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-251238654',display_name='tempest-TestVolumeBootPattern-server-251238654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-251238654',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTIlETEzrlhBz6OePq01eKR0vcasXvXhxqFCkGLx2Csd5vC2HyUqXiG76OOALVAFV1uvdeTYYEQFTuaa0BMfwlQOyATH6cj50OJFdi8LwK7LlbSEfvUgqiY4m0oMQIcqg==',key_name='tempest-TestVolumeBootPattern-1266066309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-kcl5ooel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:06:39Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=6b79f962-6eec-411d-8b07-af448df4a52f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6c:55,bridge_name='br-int',has_traffic_filtering=True,id=fefd93d8-5647-4359-b062-af773a1b1855,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfefd93d8-56') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.objects.instance [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b79f962-6eec-411d-8b07-af448df4a52f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 14:06:47 user nova-compute[70914]:   <uuid>6b79f962-6eec-411d-8b07-af448df4a52f</uuid>
Jul 27 14:06:47 user nova-compute[70914]:   <name>instance-00000031</name>
Jul 27 14:06:47 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 14:06:47 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 14:06:47 user nova-compute[70914]:   <metadata>
Jul 27 14:06:47 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 14:06:47 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 14:06:47 user nova-compute[70914]:       <nova:name>tempest-TestVolumeBootPattern-server-251238654</nova:name>
Jul 27 14:06:47 user nova-compute[70914]:       <nova:creationTime>2023-07-27 14:06:45</nova:creationTime>
Jul 27 14:06:47 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 14:06:47 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 14:06:47 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 14:06:47 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 14:06:47 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 14:06:47 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 14:06:47 user nova-compute[70914]:       </nova:flavor>
Jul 27 14:06:47 user nova-compute[70914]:       <nova:owner>
Jul 27 14:06:47 user nova-compute[70914]:         <nova:user uuid="b6161b1cf5fb4d08a8cbd36a93b8400c">tempest-TestVolumeBootPattern-1923193575-project-member</nova:user>
Jul 27 14:06:47 user nova-compute[70914]:         <nova:project uuid="c73ac071233d44fbb62e558725f63ef8">tempest-TestVolumeBootPattern-1923193575</nova:project>
Jul 27 14:06:47 user nova-compute[70914]:       </nova:owner>
Jul 27 14:06:47 user nova-compute[70914]:       <nova:ports>
Jul 27 14:06:47 user nova-compute[70914]:         <nova:port uuid="fefd93d8-5647-4359-b062-af773a1b1855">
Jul 27 14:06:47 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 14:06:47 user nova-compute[70914]:         </nova:port>
Jul 27 14:06:47 user nova-compute[70914]:       </nova:ports>
Jul 27 14:06:47 user nova-compute[70914]:     </nova:instance>
Jul 27 14:06:47 user nova-compute[70914]:   </metadata>
Jul 27 14:06:47 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 14:06:47 user nova-compute[70914]:     <system>
Jul 27 14:06:47 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 14:06:47 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 14:06:47 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 14:06:47 user nova-compute[70914]:       <entry name="serial">6b79f962-6eec-411d-8b07-af448df4a52f</entry>
Jul 27 14:06:47 user nova-compute[70914]:       <entry name="uuid">6b79f962-6eec-411d-8b07-af448df4a52f</entry>
Jul 27 14:06:47 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 14:06:47 user nova-compute[70914]:     </system>
Jul 27 14:06:47 user nova-compute[70914]:   </sysinfo>
Jul 27 14:06:47 user nova-compute[70914]:   <os>
Jul 27 14:06:47 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 14:06:47 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 14:06:47 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 14:06:47 user nova-compute[70914]:   </os>
Jul 27 14:06:47 user nova-compute[70914]:   <features>
Jul 27 14:06:47 user nova-compute[70914]:     <acpi/>
Jul 27 14:06:47 user nova-compute[70914]:     <apic/>
Jul 27 14:06:47 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 14:06:47 user nova-compute[70914]:   </features>
Jul 27 14:06:47 user nova-compute[70914]:   <clock offset="utc">
Jul 27 14:06:47 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 14:06:47 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 14:06:47 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 14:06:47 user nova-compute[70914]:   </clock>
Jul 27 14:06:47 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 14:06:47 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 14:06:47 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 14:06:47 user nova-compute[70914]:   </cpu>
Jul 27 14:06:47 user nova-compute[70914]:   <devices>
Jul 27 14:06:47 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 14:06:47 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:06:47 user nova-compute[70914]:       <source dev="/dev/sdb"/>
Jul 27 14:06:47 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 14:06:47 user nova-compute[70914]:       <serial>fe1270a3-c982-4904-98e9-c5140f6241a2</serial>
Jul 27 14:06:47 user nova-compute[70914]:     </disk>
Jul 27 14:06:47 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 14:06:47 user nova-compute[70914]:       <mac address="fa:16:3e:9e:6c:55"/>
Jul 27 14:06:47 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:06:47 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 14:06:47 user nova-compute[70914]:       <target dev="tapfefd93d8-56"/>
Jul 27 14:06:47 user nova-compute[70914]:     </interface>
Jul 27 14:06:47 user nova-compute[70914]:     <serial type="pty">
Jul 27 14:06:47 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/6b79f962-6eec-411d-8b07-af448df4a52f/console.log" append="off"/>
Jul 27 14:06:47 user nova-compute[70914]:     </serial>
Jul 27 14:06:47 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 14:06:47 user nova-compute[70914]:     <video>
Jul 27 14:06:47 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:06:47 user nova-compute[70914]:     </video>
Jul 27 14:06:47 user nova-compute[70914]:     <rng model="virtio">
Jul 27 14:06:47 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 14:06:47 user nova-compute[70914]:     </rng>
Jul 27 14:06:47 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 14:06:47 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 14:06:47 user nova-compute[70914]:       <stats period="10"/>
Jul 27 14:06:47 user nova-compute[70914]:     </memballoon>
Jul 27 14:06:47 user nova-compute[70914]:   </devices>
Jul 27 14:06:47 user nova-compute[70914]: </domain>
Jul 27 14:06:47 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-251238654',display_name='tempest-TestVolumeBootPattern-server-251238654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-251238654',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTIlETEzrlhBz6OePq01eKR0vcasXvXhxqFCkGLx2Csd5vC2HyUqXiG76OOALVAFV1uvdeTYYEQFTuaa0BMfwlQOyATH6cj50OJFdi8LwK7LlbSEfvUgqiY4m0oMQIcqg==',key_name='tempest-TestVolumeBootPattern-1266066309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-kcl5ooel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:06:39Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=6b79f962-6eec-411d-8b07-af448df4a52f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6c:55,bridge_name='br-int',has_traffic_filtering=True,id=fefd93d8-5647-4359-b062-af773a1b1855,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfefd93d8-56') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG os_vif [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6c:55,bridge_name='br-int',has_traffic_filtering=True,id=fefd93d8-5647-4359-b062-af773a1b1855,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfefd93d8-56') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfefd93d8-56, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfefd93d8-56, col_values=(('external_ids', {'iface-id': 'fefd93d8-5647-4359-b062-af773a1b1855', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:6c:55', 'vm-uuid': '6b79f962-6eec-411d-8b07-af448df4a52f'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:47 user nova-compute[70914]: INFO os_vif [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6c:55,bridge_name='br-int',has_traffic_filtering=True,id=fefd93d8-5647-4359-b062-af773a1b1855,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfefd93d8-56')
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:06:47 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No VIF found with MAC fa:16:3e:9e:6c:55, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:06:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-86c7c0e3-e800-45e1-ba23-2948336b2678 req-0f38178e-56df-4bf4-9e44-9820dc7a5d39 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received event network-vif-plugged-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:06:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86c7c0e3-e800-45e1-ba23-2948336b2678 req-0f38178e-56df-4bf4-9e44-9820dc7a5d39 service nova] Acquiring lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:06:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86c7c0e3-e800-45e1-ba23-2948336b2678 req-0f38178e-56df-4bf4-9e44-9820dc7a5d39 service nova] Lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:06:48 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-86c7c0e3-e800-45e1-ba23-2948336b2678 req-0f38178e-56df-4bf4-9e44-9820dc7a5d39 service nova] Lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:06:48 user nova-compute[70914]: DEBUG nova.compute.manager [req-86c7c0e3-e800-45e1-ba23-2948336b2678 req-0f38178e-56df-4bf4-9e44-9820dc7a5d39 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] No waiting events found dispatching network-vif-plugged-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:06:48 user nova-compute[70914]: WARNING nova.compute.manager [req-86c7c0e3-e800-45e1-ba23-2948336b2678 req-0f38178e-56df-4bf4-9e44-9820dc7a5d39 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received unexpected event network-vif-plugged-fefd93d8-5647-4359-b062-af773a1b1855 for instance with vm_state building and task_state spawning.
Jul 27 14:06:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466810.5840776, 6b79f962-6eec-411d-8b07-af448df4a52f => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:06:50 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] VM Resumed (Lifecycle Event)
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 14:06:50 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Instance spawned successfully.
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:06:50 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466810.5853264, 6b79f962-6eec-411d-8b07-af448df4a52f => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:06:50 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] VM Started (Lifecycle Event)
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:06:50 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:06:50 user nova-compute[70914]: INFO nova.compute.manager [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Took 4.88 seconds to spawn the instance on the hypervisor.
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.compute.manager [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-49332804-fd66-4524-b2b2-a35ad358753a req-387c83ec-e4e3-4583-a7b0-e2eae87aae24 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received event network-vif-plugged-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-49332804-fd66-4524-b2b2-a35ad358753a req-387c83ec-e4e3-4583-a7b0-e2eae87aae24 service nova] Acquiring lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-49332804-fd66-4524-b2b2-a35ad358753a req-387c83ec-e4e3-4583-a7b0-e2eae87aae24 service nova] Lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-49332804-fd66-4524-b2b2-a35ad358753a req-387c83ec-e4e3-4583-a7b0-e2eae87aae24 service nova] Lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:06:50 user nova-compute[70914]: DEBUG nova.compute.manager [req-49332804-fd66-4524-b2b2-a35ad358753a req-387c83ec-e4e3-4583-a7b0-e2eae87aae24 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] No waiting events found dispatching network-vif-plugged-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:06:50 user nova-compute[70914]: WARNING nova.compute.manager [req-49332804-fd66-4524-b2b2-a35ad358753a req-387c83ec-e4e3-4583-a7b0-e2eae87aae24 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received unexpected event network-vif-plugged-fefd93d8-5647-4359-b062-af773a1b1855 for instance with vm_state building and task_state spawning.
Jul 27 14:06:50 user nova-compute[70914]: INFO nova.compute.manager [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Took 12.44 seconds to build instance.
Jul 27 14:06:50 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-9940f5fd-d3a5-4f3c-a48c-0ddad112a00b tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "6b79f962-6eec-411d-8b07-af448df4a52f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.565s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:06:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:06:58 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:07:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:02 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:07:02 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:07:02 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8299MB free_disk=25.131912231445312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:07:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e1bba032-0641-430d-beee-77d4268cf47e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 6b79f962-6eec-411d-8b07-af448df4a52f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-8d0596b9-b0b1-4b02-8f08-d72b62f007fd req-67ad862d-a155-44f4-a94f-70f258456703 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received event network-changed-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.compute.manager [req-8d0596b9-b0b1-4b02-8f08-d72b62f007fd req-67ad862d-a155-44f4-a94f-70f258456703 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Refreshing instance network info cache due to event network-changed-7a46b1a7-43c3-473d-b360-5e6fddf56ae9. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8d0596b9-b0b1-4b02-8f08-d72b62f007fd req-67ad862d-a155-44f4-a94f-70f258456703 service nova] Acquiring lock "refresh_cache-e1bba032-0641-430d-beee-77d4268cf47e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8d0596b9-b0b1-4b02-8f08-d72b62f007fd req-67ad862d-a155-44f4-a94f-70f258456703 service nova] Acquired lock "refresh_cache-e1bba032-0641-430d-beee-77d4268cf47e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-8d0596b9-b0b1-4b02-8f08-d72b62f007fd req-67ad862d-a155-44f4-a94f-70f258456703 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Refreshing network info cache for port 7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-8d0596b9-b0b1-4b02-8f08-d72b62f007fd req-67ad862d-a155-44f4-a94f-70f258456703 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Updated VIF entry in instance network info cache for port 7a46b1a7-43c3-473d-b360-5e6fddf56ae9. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG nova.network.neutron [req-8d0596b9-b0b1-4b02-8f08-d72b62f007fd req-67ad862d-a155-44f4-a94f-70f258456703 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Updating instance_info_cache with network_info: [{"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:07:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8d0596b9-b0b1-4b02-8f08-d72b62f007fd req-67ad862d-a155-44f4-a94f-70f258456703 service nova] Releasing lock "refresh_cache-e1bba032-0641-430d-beee-77d4268cf47e" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:07:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "e1bba032-0641-430d-beee-77d4268cf47e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:06 user nova-compute[70914]: DEBUG nova.objects.instance [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'flavor' on Instance uuid e1bba032-0641-430d-beee-77d4268cf47e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:07:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "e1bba032-0641-430d-beee-77d4268cf47e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:07 user nova-compute[70914]: INFO nova.compute.manager [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Attaching volume ea464ac8-abc1-4266-b12f-7192d9af7a40 to /dev/vdb
Jul 27 14:07:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG os_brick.utils [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[de57a844-78ba-4d60-a67b-db793d5625e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[84df688e-0da1-4642-a527-a1502c0ebff1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9ce2f8-f2da-4ddb-97bf-0343d1218132]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b5270c-c78c-4bcd-b058-3bc19afd0a4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:07:07 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f73fba-8790-4d26-b7b2-2732348f0e5d]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG os_brick.utils [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Updating existing volume attachment record: 670d1776-57e0-451c-a034-3fc55fd66aee {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:07:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:10 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:07:10 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 14:07:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:07:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:07:10 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:07:10 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 60d35122-55c4-458e-bf51-db6d2a87b1d1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:07:11 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updating instance_info_cache with network_info: [{"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:07:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:07:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:07:11 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:12 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:12 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRHaOLnc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:07:13 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:07:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:07:13 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:07:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:07:13 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 14:07:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d91ae9-ca86-4d17-bdd3-cce9bafd715b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 14:07:13 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[202875de-6387-4d6e-b599-d46cc82fe70b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40] added
Jul 27 14:07:13 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44010b3-9dea-4ad6-a327-25969dfb49f0]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:13 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8dfc28-e538-4f04-ae60-7e9a57120ec1]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRHaOLnc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRHaOLnc" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eb63ab-e0f7-4322-8d2a-edb4773b01f2]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NRHaOLnc'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4966f05a-99dc-48d1-80ec-28b64b6d47ac]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab434e01-fadc-487e-a31a-cfb88cf1fd54]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:07:14 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:07:14 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f4c63c-71ff-422f-b358-be8347f42b9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40, portal: 172.16.0.220,3260]
Jul 27 14:07:14 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40, portal: 172.16.0.220,3260] successful.
Jul 27 14:07:14 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f955e539-3879-48d3-a091-6fd024b3bc58]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d863b8eb-98d7-4be1-b14f-1db094d3222e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:07:14 user nova-compute[70914]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 (non-flash)
Jul 27 14:07:14 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:07:14 user nova-compute[70914]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 (non-flash)
Jul 27 14:07:14 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b5dc94-ad24-422c-a073-c76c7d61d633]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRHaOLnc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 14:07:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:07:15 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23664346439303935', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:07:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664346439303935', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 14:07:15 user nova-compute[70914]: DEBUG nova.objects.instance [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'flavor' on Instance uuid e1bba032-0641-430d-beee-77d4268cf47e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:07:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 14:07:15 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:07:15 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 14:07:15 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:07:15 user nova-compute[70914]:   <serial>ea464ac8-abc1-4266-b12f-7192d9af7a40</serial>
Jul 27 14:07:15 user nova-compute[70914]: </disk>
Jul 27 14:07:15 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 14:07:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:07:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:07:15 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] No VIF found with MAC fa:16:3e:f1:65:76, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:07:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-29599bda-d81c-49f1-bb01-c7410e87e7c9 tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.603s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "e1bba032-0641-430d-beee-77d4268cf47e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:17 user nova-compute[70914]: INFO nova.compute.manager [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Detaching volume ea464ac8-abc1-4266-b12f-7192d9af7a40
Jul 27 14:07:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:17 user nova-compute[70914]: INFO nova.virt.block_device [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Attempting to driver detach volume ea464ac8-abc1-4266-b12f-7192d9af7a40 from mountpoint /dev/vdb
Jul 27 14:07:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Attempting to detach device vdb from instance e1bba032-0641-430d-beee-77d4268cf47e from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:07:17 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:07:17 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 14:07:17 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:07:17 user nova-compute[70914]:   <serial>ea464ac8-abc1-4266-b12f-7192d9af7a40</serial>
Jul 27 14:07:17 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 14:07:17 user nova-compute[70914]: </disk>
Jul 27 14:07:17 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:07:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully detached device vdb from instance e1bba032-0641-430d-beee-77d4268cf47e from the persistent domain config.
Jul 27 14:07:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1bba032-0641-430d-beee-77d4268cf47e from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:07:17 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:07:17 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 14:07:17 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:07:17 user nova-compute[70914]:   <serial>ea464ac8-abc1-4266-b12f-7192d9af7a40</serial>
Jul 27 14:07:17 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 14:07:17 user nova-compute[70914]: </disk>
Jul 27 14:07:17 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690466837.6985714, e1bba032-0641-430d-beee-77d4268cf47e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1bba032-0641-430d-beee-77d4268cf47e {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 14:07:17 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully detached device vdb from instance e1bba032-0641-430d-beee-77d4268cf47e from the live domain config.
Jul 27 14:07:17 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRHaOLnc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:07:17 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68e50e2-d5af-4d13-a771-6b613e9a3a0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:07:17 user nova-compute[70914]: No targets found.
Jul 27 14:07:17 user nova-compute[70914]: iSNS:
Jul 27 14:07:17 user nova-compute[70914]: No targets found.
Jul 27 14:07:17 user nova-compute[70914]: STATIC:
Jul 27 14:07:17 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2
Jul 27 14:07:17 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:07:17 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:07:17 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40
Jul 27 14:07:17 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:07:17 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:07:17 user nova-compute[70914]: FIRMWARE:
Jul 27 14:07:17 user nova-compute[70914]: No targets found.
Jul 27 14:07:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:07:17 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:07:17 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c454f2f-f6b5-40b1-8dc3-ba6f8bbd5594]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[faee206e-52a4-4aa1-83ef-36d14dc2a40a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:07:17 user nova-compute[70914]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 (non-flash)
Jul 27 14:07:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:07:17 user nova-compute[70914]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 (non-flash)
Jul 27 14:07:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c181a2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40'): ({'sdc'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Removing single pathed devices sdc {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb78f47-44ec-411b-84af-c87082bcc586]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3521f1cf-4782-4d6a-ad7d-bb845a359d7a]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Flushing IO for device /dev/sdc {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6c205-586e-4edb-bbf9-c61fd4fe648a]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d615ae11-f900-47a8-b210-e97e1612594a]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb223e81-ab83-46ff-bb6c-d3871de1b49b]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[af41705f-4f25-400b-9385-1477cd278a29]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40, portal: 172.16.0.220,3260]
Jul 27 14:07:17 user nova-compute[70914]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40, portal: 172.16.0.220,3260] successful.
Jul 27 14:07:17 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:17 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:18 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea464ac8-abc1-4266-b12f-7192d9af7a40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:18 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[990f64d1-af9c-4b3b-bba4-979235c1ec47]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:07:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:07:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:07:18 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] <== disconnect_volume: return (293ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:07:18 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:07:18 user nova-compute[70914]: DEBUG nova.objects.instance [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'flavor' on Instance uuid e1bba032-0641-430d-beee-77d4268cf47e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:07:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-5ed23be3-58ca-45c6-9df9-0a4a28546f1f tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-c445250f-ee5e-421f-b086-b0396847fb00 req-b42d00aa-3bae-45ef-905f-ddbaee894b87 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received event network-changed-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-c445250f-ee5e-421f-b086-b0396847fb00 req-b42d00aa-3bae-45ef-905f-ddbaee894b87 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Refreshing instance network info cache due to event network-changed-c7ad19f5-97e6-431b-bd8f-4a769804e27f. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c445250f-ee5e-421f-b086-b0396847fb00 req-b42d00aa-3bae-45ef-905f-ddbaee894b87 service nova] Acquiring lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c445250f-ee5e-421f-b086-b0396847fb00 req-b42d00aa-3bae-45ef-905f-ddbaee894b87 service nova] Acquired lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG nova.network.neutron [req-c445250f-ee5e-421f-b086-b0396847fb00 req-b42d00aa-3bae-45ef-905f-ddbaee894b87 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Refreshing network info cache for port c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:26 user nova-compute[70914]: INFO nova.compute.manager [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Terminating instance
Jul 27 14:07:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG nova.network.neutron [req-c445250f-ee5e-421f-b086-b0396847fb00 req-b42d00aa-3bae-45ef-905f-ddbaee894b87 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updated VIF entry in instance network info cache for port c7ad19f5-97e6-431b-bd8f-4a769804e27f. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:07:26 user nova-compute[70914]: DEBUG nova.network.neutron [req-c445250f-ee5e-421f-b086-b0396847fb00 req-b42d00aa-3bae-45ef-905f-ddbaee894b87 service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updating instance_info_cache with network_info: [{"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c445250f-ee5e-421f-b086-b0396847fb00 req-b42d00aa-3bae-45ef-905f-ddbaee894b87 service nova] Releasing lock "refresh_cache-3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Instance destroyed successfully.
Jul 27 14:07:27 user nova-compute[70914]: DEBUG nova.objects.instance [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'resources' on Instance uuid 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1400586611',display_name='tempest-TestStampPattern-server-1400586611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1400586611',id=47,image_ref='a46b00b5-f508-4098-a58b-ffcaa55dde09',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmLBSHyza1ghqnyyQ42csa2OCb7CLlsDqq29Po3ZvJ5ZlfPbjKBzUNAtQpBtn8A2PGxT1NM6sUeoKBKRpDDoEXF0T9Pf9kYEfBvWYc34edA7pq6zvHJD5NDhZdwsPGjdA==',key_name='tempest-TestStampPattern-1764772644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T14:04:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47dfe41ebcf84a7597ea5721759b068f',ramdisk_id='',reservation_id='r-9jmdm1ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60d35122-55c4-458e-bf51-db6d2a87b1d1',image_min_disk='1',image_min_ram='0',image_owner_id='47dfe41ebcf84a7597ea5721759b068f',image_owner_project_name='tempest-TestStampPattern-1948059244',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1948059244-project-member',image_user_id='643c0433178c46d084bcf154c766aa36',owner_project_name='tempest-TestStampPattern-1948059244',owner_user_name='tempest-TestStampPattern-1948059244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T14:04:40Z,user_data=None,user_id='643c0433178c46d084bcf154c766aa36',uuid=3c00cd20-63d3-4e80-a8f9-b3b684c12b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converting VIF {"id": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "address": "fa:16:3e:57:17:18", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ad19f5-97", "ovs_interfaceid": "c7ad19f5-97e6-431b-bd8f-4a769804e27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:17:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ad19f5-97e6-431b-bd8f-4a769804e27f,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ad19f5-97') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG os_vif [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:17:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ad19f5-97e6-431b-bd8f-4a769804e27f,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ad19f5-97') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7ad19f5-97, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:07:27 user nova-compute[70914]: INFO os_vif [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:17:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ad19f5-97e6-431b-bd8f-4a769804e27f,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ad19f5-97')
Jul 27 14:07:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Deleting instance files /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f_del
Jul 27 14:07:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Deletion of /opt/stack/data/nova/instances/3c00cd20-63d3-4e80-a8f9-b3b684c12b2f_del complete
Jul 27 14:07:27 user nova-compute[70914]: INFO nova.compute.manager [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 27 14:07:27 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:07:27 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Took 0.53 seconds to deallocate network for instance.
Jul 27 14:07:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Deleted allocations for instance 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-4a223cc1-498d-4b78-91af-b637a109e908 tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.812s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received event network-vif-unplugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] Acquiring lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] No waiting events found dispatching network-vif-unplugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.compute.manager [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received unexpected event network-vif-unplugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f for instance with vm_state deleted and task_state None.
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received event network-vif-plugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] Acquiring lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] Lock "3c00cd20-63d3-4e80-a8f9-b3b684c12b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] No waiting events found dispatching network-vif-plugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.compute.manager [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received unexpected event network-vif-plugged-c7ad19f5-97e6-431b-bd8f-4a769804e27f for instance with vm_state deleted and task_state None.
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-aa3fd550-ca93-4c73-8f43-3e17463e4281 req-878cb39d-ec6e-4b2d-8b35-d4eda06aeb5f service nova] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Received event network-vif-deleted-c7ad19f5-97e6-431b-bd8f-4a769804e27f {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Verify base images {{(pid=70914) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=70914) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Image id 33cbcfd9-c349-4c50-a3d9-7b9d8aca3776 yields fingerprint f4ce92c1b4402fa188676f70613898dee452882d {{(pid=70914) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] image 33cbcfd9-c349-4c50-a3d9-7b9d8aca3776 at (/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d): checking
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] image 33cbcfd9-c349-4c50-a3d9-7b9d8aca3776 at (/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d): image is in use {{(pid=70914) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] e1bba032-0641-430d-beee-77d4268cf47e is a valid instance name {{(pid=70914) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] e1bba032-0641-430d-beee-77d4268cf47e has a disk file {{(pid=70914) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e1bba032-0641-430d-beee-77d4268cf47e is backed by f4ce92c1b4402fa188676f70613898dee452882d {{(pid=70914) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] 60d35122-55c4-458e-bf51-db6d2a87b1d1 is a valid instance name {{(pid=70914) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] 60d35122-55c4-458e-bf51-db6d2a87b1d1 has a disk file {{(pid=70914) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 is backed by f4ce92c1b4402fa188676f70613898dee452882d {{(pid=70914) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] 6b79f962-6eec-411d-8b07-af448df4a52f is a valid instance name {{(pid=70914) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Unknown base file: /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Unknown base file: /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Unknown base file: /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Unknown base file: /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Unknown base file: /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Unknown base file: /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Unknown base file: /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Unknown base file: /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921
Jul 27 14:07:28 user nova-compute[70914]: WARNING nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Active base files: /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Removable base files: /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7 /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12 /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406 /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921 /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a46d6032a95feefb67d1e9f970e6aee86a8a08aa
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c1bc30a9f3cf1d0209308240f19a74a08dbaafa7
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3783ea8b8a7e57e5833bd476731e6c61c53d3b3d
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/97203ab909d50f9548cae25d372d8acdcae98eca
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e451b23169b8b48894d3c380e8468253ea2a4f12
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a3e4849430f9572bb3abfc5ce4944d727edcf406
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2d0b5c5c0237ea890d6b09c0fb7068c5d7b5c6ff
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8b2d7b8196b92a30ecba4c735d2ffcd878300921
Jul 27 14:07:28 user nova-compute[70914]: INFO nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d299d048935c1910c319d1020c1975af533ac5f
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Verification complete {{(pid=70914) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Verify swap images {{(pid=70914) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 27 14:07:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.imagecache [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Verify ephemeral images {{(pid=70914) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 27 14:07:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:42 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466847.2891417, 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:07:42 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] VM Stopped (Lifecycle Event)
Jul 27 14:07:42 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f8975ca8-707f-4e96-b3bf-d358424b0a16 None None] [instance: 3c00cd20-63d3-4e80-a8f9-b3b684c12b2f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:07:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:07:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:07:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:07:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:07:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:07:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:07:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:07:52 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:07:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 14:07:52 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] There are 0 instances to clean {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 14:07:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:08:00 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:01 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:02 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:08:02 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:08:02 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8487MB free_disk=25.13182830810547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance e1bba032-0641-430d-beee-77d4268cf47e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 6b79f962-6eec-411d-8b07-af448df4a52f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:08:02 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:08:03 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:08:03 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:08:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:08:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "e1bba032-0641-430d-beee-77d4268cf47e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "e1bba032-0641-430d-beee-77d4268cf47e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:07 user nova-compute[70914]: INFO nova.compute.manager [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Terminating instance
Jul 27 14:08:07 user nova-compute[70914]: DEBUG nova.compute.manager [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-c52e9677-7c71-4c53-a31b-50f48aba5c10 req-a2760033-601f-4e81-b4f0-506440101196 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received event network-vif-unplugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c52e9677-7c71-4c53-a31b-50f48aba5c10 req-a2760033-601f-4e81-b4f0-506440101196 service nova] Acquiring lock "e1bba032-0641-430d-beee-77d4268cf47e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c52e9677-7c71-4c53-a31b-50f48aba5c10 req-a2760033-601f-4e81-b4f0-506440101196 service nova] Lock "e1bba032-0641-430d-beee-77d4268cf47e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-c52e9677-7c71-4c53-a31b-50f48aba5c10 req-a2760033-601f-4e81-b4f0-506440101196 service nova] Lock "e1bba032-0641-430d-beee-77d4268cf47e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-c52e9677-7c71-4c53-a31b-50f48aba5c10 req-a2760033-601f-4e81-b4f0-506440101196 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] No waiting events found dispatching network-vif-unplugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG nova.compute.manager [req-c52e9677-7c71-4c53-a31b-50f48aba5c10 req-a2760033-601f-4e81-b4f0-506440101196 service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received event network-vif-unplugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:08 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Instance destroyed successfully.
Jul 27 14:08:08 user nova-compute[70914]: DEBUG nova.objects.instance [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lazy-loading 'resources' on Instance uuid e1bba032-0641-430d-beee-77d4268cf47e {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:08:08 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1154378852',display_name='tempest-AttachVolumeNegativeTest-server-1154378852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1154378852',id=48,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDprrpn/RO2ExIhAIL1k/JserykIAE4alEEODJ4ocMVngCQAApanXk7q7BdLsCn3GB6bpkF3rhwUmAvwLCs9NEgEyY9GZgJuGlGQZj2kLuZrHEK3hFwxevF3W8NOEffVsQ==',key_name='tempest-keypair-1108767487',keypairs=<?>,launch_index=0,launched_at=2023-07-27T14:05:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8032e7912884d3bb9a66632f95137ad',ramdisk_id='',reservation_id='r-3q99fsld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-431364948',owner_user_name='tempest-AttachVolumeNegativeTest-431364948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T14:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c9278ea5d24d2a9182c20bcb32febb',uuid=e1bba032-0641-430d-beee-77d4268cf47e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:08:08 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converting VIF {"id": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "address": "fa:16:3e:f1:65:76", "network": {"id": "f84ed9bb-45ca-4a07-9dce-99dacc923340", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-458791450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8032e7912884d3bb9a66632f95137ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a46b1a7-43", "ovs_interfaceid": "7a46b1a7-43c3-473d-b360-5e6fddf56ae9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:08:08 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:65:76,bridge_name='br-int',has_traffic_filtering=True,id=7a46b1a7-43c3-473d-b360-5e6fddf56ae9,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a46b1a7-43') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:08:08 user nova-compute[70914]: DEBUG os_vif [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:65:76,bridge_name='br-int',has_traffic_filtering=True,id=7a46b1a7-43c3-473d-b360-5e6fddf56ae9,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a46b1a7-43') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:08:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a46b1a7-43, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:08:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:08:08 user nova-compute[70914]: INFO os_vif [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:65:76,bridge_name='br-int',has_traffic_filtering=True,id=7a46b1a7-43c3-473d-b360-5e6fddf56ae9,network=Network(f84ed9bb-45ca-4a07-9dce-99dacc923340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a46b1a7-43')
Jul 27 14:08:08 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Deleting instance files /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e_del
Jul 27 14:08:08 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Deletion of /opt/stack/data/nova/instances/e1bba032-0641-430d-beee-77d4268cf47e_del complete
Jul 27 14:08:08 user nova-compute[70914]: INFO nova.compute.manager [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Took 0.83 seconds to destroy the instance on the hypervisor.
Jul 27 14:08:08 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:08:08 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:08:08 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: e1bba032-0641-430d-beee-77d4268cf47e] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:08:09 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Took 1.28 seconds to deallocate network for instance.
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-391810a8-77bb-4d4f-8aa1-39e1aa985d37 req-a69075ae-9b14-4cff-9fcc-863d3a88223e service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received event network-vif-plugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-391810a8-77bb-4d4f-8aa1-39e1aa985d37 req-a69075ae-9b14-4cff-9fcc-863d3a88223e service nova] Acquiring lock "e1bba032-0641-430d-beee-77d4268cf47e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-391810a8-77bb-4d4f-8aa1-39e1aa985d37 req-a69075ae-9b14-4cff-9fcc-863d3a88223e service nova] Lock "e1bba032-0641-430d-beee-77d4268cf47e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-391810a8-77bb-4d4f-8aa1-39e1aa985d37 req-a69075ae-9b14-4cff-9fcc-863d3a88223e service nova] Lock "e1bba032-0641-430d-beee-77d4268cf47e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-391810a8-77bb-4d4f-8aa1-39e1aa985d37 req-a69075ae-9b14-4cff-9fcc-863d3a88223e service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] No waiting events found dispatching network-vif-plugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:08:09 user nova-compute[70914]: WARNING nova.compute.manager [req-391810a8-77bb-4d4f-8aa1-39e1aa985d37 req-a69075ae-9b14-4cff-9fcc-863d3a88223e service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received unexpected event network-vif-plugged-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 for instance with vm_state deleted and task_state None.
Jul 27 14:08:09 user nova-compute[70914]: DEBUG nova.compute.manager [req-391810a8-77bb-4d4f-8aa1-39e1aa985d37 req-a69075ae-9b14-4cff-9fcc-863d3a88223e service nova] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Received event network-vif-deleted-7a46b1a7-43c3-473d-b360-5e6fddf56ae9 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:09 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Deleted allocations for instance e1bba032-0641-430d-beee-77d4268cf47e
Jul 27 14:08:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-46092843-7128-45fe-b3b3-6cbf4465832a tempest-AttachVolumeNegativeTest-431364948 tempest-AttachVolumeNegativeTest-431364948-project-member] Lock "e1bba032-0641-430d-beee-77d4268cf47e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.478s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:11 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:08:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:08:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:08:11 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:08:12 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updating instance_info_cache with network_info: [{"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:08:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:08:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:08:12 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:13 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:14 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:17 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:08:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:08:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:08:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:08:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:23 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466888.2006142, e1bba032-0641-430d-beee-77d4268cf47e => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:08:23 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: e1bba032-0641-430d-beee-77d4268cf47e] VM Stopped (Lifecycle Event)
Jul 27 14:08:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-6adc2de4-9fec-4b22-a027-9d803d10b926 None None] [instance: e1bba032-0641-430d-beee-77d4268cf47e] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:08:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:23 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:23 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances with incomplete migration  {{(pid=70914) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-e41d72e2-d4dd-47ef-81c1-87e1154f310c req-41b539e0-c1b3-496e-9612-855c2efb002e service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received event network-changed-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-e41d72e2-d4dd-47ef-81c1-87e1154f310c req-41b539e0-c1b3-496e-9612-855c2efb002e service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Refreshing instance network info cache due to event network-changed-19753b73-1f3e-4620-832c-3d9ef7827622. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e41d72e2-d4dd-47ef-81c1-87e1154f310c req-41b539e0-c1b3-496e-9612-855c2efb002e service nova] Acquiring lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e41d72e2-d4dd-47ef-81c1-87e1154f310c req-41b539e0-c1b3-496e-9612-855c2efb002e service nova] Acquired lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG nova.network.neutron [req-e41d72e2-d4dd-47ef-81c1-87e1154f310c req-41b539e0-c1b3-496e-9612-855c2efb002e service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Refreshing network info cache for port 19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:26 user nova-compute[70914]: INFO nova.compute.manager [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Terminating instance
Jul 27 14:08:26 user nova-compute[70914]: DEBUG nova.compute.manager [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG nova.network.neutron [req-e41d72e2-d4dd-47ef-81c1-87e1154f310c req-41b539e0-c1b3-496e-9612-855c2efb002e service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updated VIF entry in instance network info cache for port 19753b73-1f3e-4620-832c-3d9ef7827622. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG nova.network.neutron [req-e41d72e2-d4dd-47ef-81c1-87e1154f310c req-41b539e0-c1b3-496e-9612-855c2efb002e service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updating instance_info_cache with network_info: [{"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e41d72e2-d4dd-47ef-81c1-87e1154f310c req-41b539e0-c1b3-496e-9612-855c2efb002e service nova] Releasing lock "refresh_cache-60d35122-55c4-458e-bf51-db6d2a87b1d1" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:08:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Instance destroyed successfully.
Jul 27 14:08:27 user nova-compute[70914]: DEBUG nova.objects.instance [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lazy-loading 'resources' on Instance uuid 60d35122-55c4-458e-bf51-db6d2a87b1d1 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-816530875',display_name='tempest-TestStampPattern-server-816530875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-816530875',id=45,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmLBSHyza1ghqnyyQ42csa2OCb7CLlsDqq29Po3ZvJ5ZlfPbjKBzUNAtQpBtn8A2PGxT1NM6sUeoKBKRpDDoEXF0T9Pf9kYEfBvWYc34edA7pq6zvHJD5NDhZdwsPGjdA==',key_name='tempest-TestStampPattern-1764772644',keypairs=<?>,launch_index=0,launched_at=2023-07-27T14:01:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47dfe41ebcf84a7597ea5721759b068f',ramdisk_id='',reservation_id='r-bu20nc8y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1948059244',owner_user_name='tempest-TestStampPattern-1948059244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T14:04:31Z,user_data=None,user_id='643c0433178c46d084bcf154c766aa36',uuid=60d35122-55c4-458e-bf51-db6d2a87b1d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converting VIF {"id": "19753b73-1f3e-4620-832c-3d9ef7827622", "address": "fa:16:3e:ca:48:26", "network": {"id": "3f77861b-b7a6-40fb-81a5-3f6bb6d8783b", "bridge": "br-int", "label": "tempest-TestStampPattern-717951238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dfe41ebcf84a7597ea5721759b068f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19753b73-1f", "ovs_interfaceid": "19753b73-1f3e-4620-832c-3d9ef7827622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:48:26,bridge_name='br-int',has_traffic_filtering=True,id=19753b73-1f3e-4620-832c-3d9ef7827622,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19753b73-1f') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG os_vif [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:48:26,bridge_name='br-int',has_traffic_filtering=True,id=19753b73-1f3e-4620-832c-3d9ef7827622,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19753b73-1f') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19753b73-1f, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:08:27 user nova-compute[70914]: INFO os_vif [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:48:26,bridge_name='br-int',has_traffic_filtering=True,id=19753b73-1f3e-4620-832c-3d9ef7827622,network=Network(3f77861b-b7a6-40fb-81a5-3f6bb6d8783b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19753b73-1f')
Jul 27 14:08:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Deleting instance files /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1_del
Jul 27 14:08:27 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Deletion of /opt/stack/data/nova/instances/60d35122-55c4-458e-bf51-db6d2a87b1d1_del complete
Jul 27 14:08:27 user nova-compute[70914]: INFO nova.compute.manager [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 27 14:08:27 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:08:27 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-263efe6c-1f31-492b-9395-afb13e3881c6 req-d1ca1295-fce0-43b0-b663-7ed84919ff51 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received event network-vif-deleted-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:28 user nova-compute[70914]: INFO nova.compute.manager [req-263efe6c-1f31-492b-9395-afb13e3881c6 req-d1ca1295-fce0-43b0-b663-7ed84919ff51 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Neutron deleted interface 19753b73-1f3e-4620-832c-3d9ef7827622; detaching it from the instance and deleting it from the info cache
Jul 27 14:08:28 user nova-compute[70914]: DEBUG nova.network.neutron [req-263efe6c-1f31-492b-9395-afb13e3881c6 req-d1ca1295-fce0-43b0-b663-7ed84919ff51 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:08:28 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Took 0.54 seconds to deallocate network for instance.
Jul 27 14:08:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-263efe6c-1f31-492b-9395-afb13e3881c6 req-d1ca1295-fce0-43b0-b663-7ed84919ff51 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Detach interface failed, port_id=19753b73-1f3e-4620-832c-3d9ef7827622, reason: Instance 60d35122-55c4-458e-bf51-db6d2a87b1d1 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:28 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Deleted allocations for instance 60d35122-55c4-458e-bf51-db6d2a87b1d1
Jul 27 14:08:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-a0327211-dd8d-4f0e-913e-c5ac9a6a5d2e tempest-TestStampPattern-1948059244 tempest-TestStampPattern-1948059244-project-member] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.671s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received event network-vif-unplugged-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] Acquiring lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] No waiting events found dispatching network-vif-unplugged-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:08:28 user nova-compute[70914]: WARNING nova.compute.manager [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received unexpected event network-vif-unplugged-19753b73-1f3e-4620-832c-3d9ef7827622 for instance with vm_state deleted and task_state None.
Jul 27 14:08:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received event network-vif-plugged-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] Acquiring lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] Lock "60d35122-55c4-458e-bf51-db6d2a87b1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:28 user nova-compute[70914]: DEBUG nova.compute.manager [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] No waiting events found dispatching network-vif-plugged-19753b73-1f3e-4620-832c-3d9ef7827622 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:08:28 user nova-compute[70914]: WARNING nova.compute.manager [req-2b454c70-c6a7-4b18-a78b-73f04f372c23 req-ac46da88-5178-4cd8-98fc-6c46553fd494 service nova] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Received unexpected event network-vif-plugged-19753b73-1f3e-4620-832c-3d9ef7827622 for instance with vm_state deleted and task_state None.
Jul 27 14:08:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-e7d85cb9-1d26-4a70-bcbd-993dac195bb9 req-2fc42f6d-815e-4ca1-afbe-2577d4e8ee3c service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received event network-changed-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:30 user nova-compute[70914]: DEBUG nova.compute.manager [req-e7d85cb9-1d26-4a70-bcbd-993dac195bb9 req-2fc42f6d-815e-4ca1-afbe-2577d4e8ee3c service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Refreshing instance network info cache due to event network-changed-fefd93d8-5647-4359-b062-af773a1b1855. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:08:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e7d85cb9-1d26-4a70-bcbd-993dac195bb9 req-2fc42f6d-815e-4ca1-afbe-2577d4e8ee3c service nova] Acquiring lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:08:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e7d85cb9-1d26-4a70-bcbd-993dac195bb9 req-2fc42f6d-815e-4ca1-afbe-2577d4e8ee3c service nova] Acquired lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:08:30 user nova-compute[70914]: DEBUG nova.network.neutron [req-e7d85cb9-1d26-4a70-bcbd-993dac195bb9 req-2fc42f6d-815e-4ca1-afbe-2577d4e8ee3c service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Refreshing network info cache for port fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:08:31 user nova-compute[70914]: DEBUG nova.network.neutron [req-e7d85cb9-1d26-4a70-bcbd-993dac195bb9 req-2fc42f6d-815e-4ca1-afbe-2577d4e8ee3c service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updated VIF entry in instance network info cache for port fefd93d8-5647-4359-b062-af773a1b1855. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:08:31 user nova-compute[70914]: DEBUG nova.network.neutron [req-e7d85cb9-1d26-4a70-bcbd-993dac195bb9 req-2fc42f6d-815e-4ca1-afbe-2577d4e8ee3c service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updating instance_info_cache with network_info: [{"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:08:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-e7d85cb9-1d26-4a70-bcbd-993dac195bb9 req-2fc42f6d-815e-4ca1-afbe-2577d4e8ee3c service nova] Releasing lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:08:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:42 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690466907.498866, 60d35122-55c4-458e-bf51-db6d2a87b1d1 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:08:42 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] VM Stopped (Lifecycle Event)
Jul 27 14:08:42 user nova-compute[70914]: DEBUG nova.compute.manager [None req-5090a4ee-51c6-4036-8f7d-24a8a63be501 None None] [instance: 60d35122-55c4-458e-bf51-db6d2a87b1d1] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:08:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "0b36bcfb-0397-4560-9db0-467ba39df327" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0b36bcfb-0397-4560-9db0-467ba39df327" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:43 user nova-compute[70914]: DEBUG nova.compute.manager [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 14:08:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:43 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 14:08:43 user nova-compute[70914]: INFO nova.compute.claims [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Claim successful on node user
Jul 27 14:08:44 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 14:08:44 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 14:08:44 user nova-compute[70914]: DEBUG nova.compute.manager [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 14:08:44 user nova-compute[70914]: INFO nova.virt.block_device [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Booting with volume 8ab811e2-fd92-47d3-98e7-6ffc550480d5 at /dev/vda
Jul 27 14:08:44 user nova-compute[70914]: DEBUG nova.policy [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6161b1cf5fb4d08a8cbd36a93b8400c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ac071233d44fbb62e558725f63ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG os_brick.utils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b26bd6-4db2-4c01-818f-3227467d3ee6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c2502d-5ef2-436e-a942-ee1f9fc8fc06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb90179-1510-4121-8197-b6fb4b4d9d06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad30d4b-5c89-44ac-b404-9dae0c8216fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:08:44 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 14:08:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd03504-9810-469b-a62e-9eedb2bdf5dc]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG os_brick.utils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updating existing volume attachment record: c8f699c3-07c1-4a0a-a3e7-c24a196a6177 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 14:08:44 user nova-compute[70914]: DEBUG nova.network.neutron [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Successfully created port: ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Successfully updated port: ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquired lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG nova.compute.manager [req-8595555f-29d1-4581-a9be-70e04d657464 req-75d5f9bf-8fcf-4189-9e10-a427b872b565 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received event network-changed-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG nova.compute.manager [req-8595555f-29d1-4581-a9be-70e04d657464 req-75d5f9bf-8fcf-4189-9e10-a427b872b565 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Refreshing instance network info cache due to event network-changed-ecaebd7e-86ae-46a0-8e70-151d69e72fc6. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8595555f-29d1-4581-a9be-70e04d657464 req-75d5f9bf-8fcf-4189-9e10-a427b872b565 service nova] Acquiring lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG nova.network.neutron [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updating instance_info_cache with network_info: [{"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Releasing lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG nova.compute.manager [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Instance network_info: |[{"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8595555f-29d1-4581-a9be-70e04d657464 req-75d5f9bf-8fcf-4189-9e10-a427b872b565 service nova] Acquired lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:08:45 user nova-compute[70914]: DEBUG nova.network.neutron [req-8595555f-29d1-4581-a9be-70e04d657464 req-75d5f9bf-8fcf-4189-9e10-a427b872b565 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Refreshing network info cache for port ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:08:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-8595555f-29d1-4581-a9be-70e04d657464 req-75d5f9bf-8fcf-4189-9e10-a427b872b565 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updated VIF entry in instance network info cache for port ecaebd7e-86ae-46a0-8e70-151d69e72fc6. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:08:46 user nova-compute[70914]: DEBUG nova.network.neutron [req-8595555f-29d1-4581-a9be-70e04d657464 req-75d5f9bf-8fcf-4189-9e10-a427b872b565 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updating instance_info_cache with network_info: [{"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:08:46 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8595555f-29d1-4581-a9be-70e04d657464 req-75d5f9bf-8fcf-4189-9e10-a427b872b565 service nova] Releasing lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:08:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:08:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.compute.manager [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 14:08:51 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Creating image(s)
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Did not create local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Ensure instance console log exists: /opt/stack/data/nova/instances/0b36bcfb-0397-4560-9db0-467ba39df327/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Start _get_guest_xml network_info=[{"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'c8f699c3-07c1-4a0a-a3e7-c24a196a6177', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPMRJACs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0b36bcfb-0397-4560-9db0-467ba39df327', 'attached_at': '', 'detached_at': '', 'volume_id': '8ab811e2-fd92-47d3-98e7-6ffc550480d5', 'serial': '8ab811e2-fd92-47d3-98e7-6ffc550480d5'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 14:08:51 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:08:51 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPMRJACs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:08:51 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:08:51 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:08:51 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca06e56-7edd-4295-b1ec-5cf2e6581585]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 14:08:51 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[285e22f8-814c-4ae7-aa07-0617001c1dc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5] added
Jul 27 14:08:51 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dd66c2-1387-48ac-aa0b-9d5b966a2746]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eca37a8-b625-4aa7-bd5d-89eff860e980]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPMRJACs {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPMRJACs" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4781309-6f59-48e2-a90d-edf442538855]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dPMRJACs'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d89a4ec-28da-4685-a31a-f1a474e554e9]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae58bd8d-c0ab-4b5b-8ea5-10a4e222ac68]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:08:51 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:08:51 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a6b1a0-cae0-4e53-930a-29ff3e4e0760]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5, portal: 172.16.0.220,3260]
Jul 27 14:08:51 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5, portal: 172.16.0.220,3260] successful.
Jul 27 14:08:51 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6563ffa-584e-40ad-a2b4-812ee799990d]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b306d5d-c95b-4eb5-818e-09bba2fefce2]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:08:51 user nova-compute[70914]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 (non-flash)
Jul 27 14:08:51 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:08:51 user nova-compute[70914]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 (non-flash)
Jul 27 14:08:51 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c232d83-b4b2-4756-b237-efe7f82bcbee]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:08:51 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPMRJACs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26561643333636438', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561643333636438', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1893269946',display_name='tempest-TestVolumeBootPattern-server-1893269946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1893269946',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTIlETEzrlhBz6OePq01eKR0vcasXvXhxqFCkGLx2Csd5vC2HyUqXiG76OOALVAFV1uvdeTYYEQFTuaa0BMfwlQOyATH6cj50OJFdi8LwK7LlbSEfvUgqiY4m0oMQIcqg==',key_name='tempest-TestVolumeBootPattern-1266066309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-kn3hop81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:08:44Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=0b36bcfb-0397-4560-9db0-467ba39df327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:da:e6,bridge_name='br-int',has_traffic_filtering=True,id=ecaebd7e-86ae-46a0-8e70-151d69e72fc6,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecaebd7e-86') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.objects.instance [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b36bcfb-0397-4560-9db0-467ba39df327 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] End _get_guest_xml xml=<domain type="kvm">
Jul 27 14:08:52 user nova-compute[70914]:   <uuid>0b36bcfb-0397-4560-9db0-467ba39df327</uuid>
Jul 27 14:08:52 user nova-compute[70914]:   <name>instance-00000032</name>
Jul 27 14:08:52 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 14:08:52 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 14:08:52 user nova-compute[70914]:   <metadata>
Jul 27 14:08:52 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 14:08:52 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 14:08:52 user nova-compute[70914]:       <nova:name>tempest-TestVolumeBootPattern-server-1893269946</nova:name>
Jul 27 14:08:52 user nova-compute[70914]:       <nova:creationTime>2023-07-27 14:08:51</nova:creationTime>
Jul 27 14:08:52 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 14:08:52 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 14:08:52 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 14:08:52 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 14:08:52 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 14:08:52 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 14:08:52 user nova-compute[70914]:       </nova:flavor>
Jul 27 14:08:52 user nova-compute[70914]:       <nova:owner>
Jul 27 14:08:52 user nova-compute[70914]:         <nova:user uuid="b6161b1cf5fb4d08a8cbd36a93b8400c">tempest-TestVolumeBootPattern-1923193575-project-member</nova:user>
Jul 27 14:08:52 user nova-compute[70914]:         <nova:project uuid="c73ac071233d44fbb62e558725f63ef8">tempest-TestVolumeBootPattern-1923193575</nova:project>
Jul 27 14:08:52 user nova-compute[70914]:       </nova:owner>
Jul 27 14:08:52 user nova-compute[70914]:       <nova:ports>
Jul 27 14:08:52 user nova-compute[70914]:         <nova:port uuid="ecaebd7e-86ae-46a0-8e70-151d69e72fc6">
Jul 27 14:08:52 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 14:08:52 user nova-compute[70914]:         </nova:port>
Jul 27 14:08:52 user nova-compute[70914]:       </nova:ports>
Jul 27 14:08:52 user nova-compute[70914]:     </nova:instance>
Jul 27 14:08:52 user nova-compute[70914]:   </metadata>
Jul 27 14:08:52 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 14:08:52 user nova-compute[70914]:     <system>
Jul 27 14:08:52 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 14:08:52 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 14:08:52 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 14:08:52 user nova-compute[70914]:       <entry name="serial">0b36bcfb-0397-4560-9db0-467ba39df327</entry>
Jul 27 14:08:52 user nova-compute[70914]:       <entry name="uuid">0b36bcfb-0397-4560-9db0-467ba39df327</entry>
Jul 27 14:08:52 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 14:08:52 user nova-compute[70914]:     </system>
Jul 27 14:08:52 user nova-compute[70914]:   </sysinfo>
Jul 27 14:08:52 user nova-compute[70914]:   <os>
Jul 27 14:08:52 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 14:08:52 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 14:08:52 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 14:08:52 user nova-compute[70914]:   </os>
Jul 27 14:08:52 user nova-compute[70914]:   <features>
Jul 27 14:08:52 user nova-compute[70914]:     <acpi/>
Jul 27 14:08:52 user nova-compute[70914]:     <apic/>
Jul 27 14:08:52 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 14:08:52 user nova-compute[70914]:   </features>
Jul 27 14:08:52 user nova-compute[70914]:   <clock offset="utc">
Jul 27 14:08:52 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 14:08:52 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 14:08:52 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 14:08:52 user nova-compute[70914]:   </clock>
Jul 27 14:08:52 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 14:08:52 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 14:08:52 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 14:08:52 user nova-compute[70914]:   </cpu>
Jul 27 14:08:52 user nova-compute[70914]:   <devices>
Jul 27 14:08:52 user nova-compute[70914]:     <disk type="block" device="disk">
Jul 27 14:08:52 user nova-compute[70914]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:08:52 user nova-compute[70914]:       <source dev="/dev/sdc"/>
Jul 27 14:08:52 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 14:08:52 user nova-compute[70914]:       <serial>8ab811e2-fd92-47d3-98e7-6ffc550480d5</serial>
Jul 27 14:08:52 user nova-compute[70914]:     </disk>
Jul 27 14:08:52 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 14:08:52 user nova-compute[70914]:       <mac address="fa:16:3e:97:da:e6"/>
Jul 27 14:08:52 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:08:52 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 14:08:52 user nova-compute[70914]:       <target dev="tapecaebd7e-86"/>
Jul 27 14:08:52 user nova-compute[70914]:     </interface>
Jul 27 14:08:52 user nova-compute[70914]:     <serial type="pty">
Jul 27 14:08:52 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/0b36bcfb-0397-4560-9db0-467ba39df327/console.log" append="off"/>
Jul 27 14:08:52 user nova-compute[70914]:     </serial>
Jul 27 14:08:52 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 14:08:52 user nova-compute[70914]:     <video>
Jul 27 14:08:52 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:08:52 user nova-compute[70914]:     </video>
Jul 27 14:08:52 user nova-compute[70914]:     <rng model="virtio">
Jul 27 14:08:52 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 14:08:52 user nova-compute[70914]:     </rng>
Jul 27 14:08:52 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 14:08:52 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 14:08:52 user nova-compute[70914]:       <stats period="10"/>
Jul 27 14:08:52 user nova-compute[70914]:     </memballoon>
Jul 27 14:08:52 user nova-compute[70914]:   </devices>
Jul 27 14:08:52 user nova-compute[70914]: </domain>
Jul 27 14:08:52 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1893269946',display_name='tempest-TestVolumeBootPattern-server-1893269946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1893269946',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTIlETEzrlhBz6OePq01eKR0vcasXvXhxqFCkGLx2Csd5vC2HyUqXiG76OOALVAFV1uvdeTYYEQFTuaa0BMfwlQOyATH6cj50OJFdi8LwK7LlbSEfvUgqiY4m0oMQIcqg==',key_name='tempest-TestVolumeBootPattern-1266066309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-kn3hop81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:08:44Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=0b36bcfb-0397-4560-9db0-467ba39df327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:da:e6,bridge_name='br-int',has_traffic_filtering=True,id=ecaebd7e-86ae-46a0-8e70-151d69e72fc6,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecaebd7e-86') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG os_vif [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:da:e6,bridge_name='br-int',has_traffic_filtering=True,id=ecaebd7e-86ae-46a0-8e70-151d69e72fc6,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecaebd7e-86') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecaebd7e-86, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapecaebd7e-86, col_values=(('external_ids', {'iface-id': 'ecaebd7e-86ae-46a0-8e70-151d69e72fc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:da:e6', 'vm-uuid': '0b36bcfb-0397-4560-9db0-467ba39df327'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:52 user nova-compute[70914]: INFO os_vif [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:da:e6,bridge_name='br-int',has_traffic_filtering=True,id=ecaebd7e-86ae-46a0-8e70-151d69e72fc6,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecaebd7e-86')
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:08:52 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] No VIF found with MAC fa:16:3e:97:da:e6, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:08:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-1141ab1b-5fe3-4f2f-97b5-c12602410dfb req-28dc5812-3c12-4e86-a6f2-b0d7f226270d service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received event network-vif-plugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1141ab1b-5fe3-4f2f-97b5-c12602410dfb req-28dc5812-3c12-4e86-a6f2-b0d7f226270d service nova] Acquiring lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1141ab1b-5fe3-4f2f-97b5-c12602410dfb req-28dc5812-3c12-4e86-a6f2-b0d7f226270d service nova] Lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:54 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-1141ab1b-5fe3-4f2f-97b5-c12602410dfb req-28dc5812-3c12-4e86-a6f2-b0d7f226270d service nova] Lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:54 user nova-compute[70914]: DEBUG nova.compute.manager [req-1141ab1b-5fe3-4f2f-97b5-c12602410dfb req-28dc5812-3c12-4e86-a6f2-b0d7f226270d service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] No waiting events found dispatching network-vif-plugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:08:54 user nova-compute[70914]: WARNING nova.compute.manager [req-1141ab1b-5fe3-4f2f-97b5-c12602410dfb req-28dc5812-3c12-4e86-a6f2-b0d7f226270d service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received unexpected event network-vif-plugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 for instance with vm_state building and task_state spawning.
Jul 27 14:08:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:08:54 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_power_states {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:08:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 6b79f962-6eec-411d-8b07-af448df4a52f {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 14:08:55 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Triggering sync for uuid 0b36bcfb-0397-4560-9db0-467ba39df327 {{(pid=70914) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 14:08:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "6b79f962-6eec-411d-8b07-af448df4a52f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "6b79f962-6eec-411d-8b07-af448df4a52f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "0b36bcfb-0397-4560-9db0-467ba39df327" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:55 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "6b79f962-6eec-411d-8b07-af448df4a52f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466936.0764668, 0b36bcfb-0397-4560-9db0-467ba39df327 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:08:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] VM Resumed (Lifecycle Event)
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 14:08:56 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Instance spawned successfully.
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:08:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690466936.0772586, 0b36bcfb-0397-4560-9db0-467ba39df327 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:08:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] VM Started (Lifecycle Event)
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:08:56 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:08:56 user nova-compute[70914]: INFO nova.compute.manager [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Took 4.88 seconds to spawn the instance on the hypervisor.
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.compute.manager [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:08:56 user nova-compute[70914]: INFO nova.compute.manager [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Took 12.45 seconds to build instance.
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a9b0c1d-5f97-4272-99bf-a4b42e93684c req-9fdad145-3635-4c34-86e8-8c0054058cc8 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received event network-vif-plugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a9b0c1d-5f97-4272-99bf-a4b42e93684c req-9fdad145-3635-4c34-86e8-8c0054058cc8 service nova] Acquiring lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a9b0c1d-5f97-4272-99bf-a4b42e93684c req-9fdad145-3635-4c34-86e8-8c0054058cc8 service nova] Lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-2a9b0c1d-5f97-4272-99bf-a4b42e93684c req-9fdad145-3635-4c34-86e8-8c0054058cc8 service nova] Lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG nova.compute.manager [req-2a9b0c1d-5f97-4272-99bf-a4b42e93684c req-9fdad145-3635-4c34-86e8-8c0054058cc8 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] No waiting events found dispatching network-vif-plugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:08:56 user nova-compute[70914]: WARNING nova.compute.manager [req-2a9b0c1d-5f97-4272-99bf-a4b42e93684c req-9fdad145-3635-4c34-86e8-8c0054058cc8 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received unexpected event network-vif-plugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 for instance with vm_state active and task_state None.
Jul 27 14:08:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-10b32b69-8020-4782-b2bf-798d694d6e26 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0b36bcfb-0397-4560-9db0-467ba39df327" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.540s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "0b36bcfb-0397-4560-9db0-467ba39df327" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.306s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:08:56 user nova-compute[70914]: INFO nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:08:56 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "0b36bcfb-0397-4560-9db0-467ba39df327" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:08:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:09:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:09:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:09:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:09:03 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:09:03 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:09:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:09:03 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:09:04 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:09:04 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8530MB free_disk=25.274925231933594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 6b79f962-6eec-411d-8b07-af448df4a52f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0b36bcfb-0397-4560-9db0-467ba39df327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Refreshing inventories for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Updating ProviderTree inventory for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Refreshing aggregate associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, aggregates: None {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Refreshing trait associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:09:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:08 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:09:08 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:09:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:11 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:09:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:09:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:13 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:09:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:09:13 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 14:09:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:09:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:09:13 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:09:13 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 6b79f962-6eec-411d-8b07-af448df4a52f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:09:14 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updating instance_info_cache with network_info: [{"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:09:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:09:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:09:14 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:09:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:15 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:09:15 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:09:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:09:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:09:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:09:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:09:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:09:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:09:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:09:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:09:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:09:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:09:42 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:09:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:09:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:09:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:09:47 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:09:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:09:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:09:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:09:52 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:09:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:09:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:09:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:09:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:09:57 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:10:02 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:05 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:10:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:05 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:05 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:10:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:10:05 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:10:06 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:10:06 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:10:06 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.271636962890625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:10:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:06 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 6b79f962-6eec-411d-8b07-af448df4a52f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:10:06 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 0b36bcfb-0397-4560-9db0-467ba39df327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:10:06 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:10:06 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:10:06 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:10:06 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:10:06 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:10:06 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:07 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:10:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:10:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:10:11 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:10:11 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:10:12 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:10:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:10:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:10:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:10:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:10:12 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:10:13 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:10:14 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:10:15 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:10:15 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:10:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:10:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:10:15 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:10:16 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updating instance_info_cache with network_info: [{"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:10:16 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:10:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:10:16 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:10:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:17 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:22 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:27 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Starting instance... {{(pid=70914) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70914) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 14:10:30 user nova-compute[70914]: INFO nova.compute.claims [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Claim successful on node user
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Start building networks asynchronously for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Allocating IP information in the background. {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.network.neutron [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] allocate_for_instance() {{(pid=70914) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 14:10:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Start building block device mappings for instance. {{(pid=70914) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.policy [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '224a0c3b1ac7497b874c68eb18048d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99080d53a44d4aafb4db49b58007653e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70914) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.compute.manager [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Start spawning the instance on the hypervisor. {{(pid=70914) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Creating instance directory {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 14:10:30 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Creating image(s)
Jul 27 14:10:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "/opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "/opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "/opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:30 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "f4ce92c1b4402fa188676f70613898dee452882d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk 1073741824 {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d,backing_fmt=raw /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk 1073741824" returned: 0 in 0.052s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "f4ce92c1b4402fa188676f70613898dee452882d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f4ce92c1b4402fa188676f70613898dee452882d --force-share --output=json" returned: 0 in 0.156s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk. size=1073741824 {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG nova.network.neutron [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Successfully created port: decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG nova.virt.disk.api [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Cannot resize image /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk to a smaller size. {{(pid=70914) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG nova.objects.instance [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lazy-loading 'migration_context' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Created local disks {{(pid=70914) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Ensure instance console log exists: /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/console.log {{(pid=70914) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:31 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Successfully updated port: decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquired lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Building network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Instance cache missing network info. {{(pid=70914) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-90158879-b95c-492a-b0d9-d0735d4a8fa5 req-b58245e9-9b42-4f3a-acbf-efdeea42e597 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received event network-changed-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.compute.manager [req-90158879-b95c-492a-b0d9-d0735d4a8fa5 req-b58245e9-9b42-4f3a-acbf-efdeea42e597 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Refreshing instance network info cache due to event network-changed-decc6867-e855-477d-b786-e39d0e8e4b02. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-90158879-b95c-492a-b0d9-d0735d4a8fa5 req-b58245e9-9b42-4f3a-acbf-efdeea42e597 service nova] Acquiring lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.network.neutron [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updating instance_info_cache with network_info: [{"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Releasing lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.compute.manager [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Instance network_info: |[{"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70914) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-90158879-b95c-492a-b0d9-d0735d4a8fa5 req-b58245e9-9b42-4f3a-acbf-efdeea42e597 service nova] Acquired lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.network.neutron [req-90158879-b95c-492a-b0d9-d0735d4a8fa5 req-b58245e9-9b42-4f3a-acbf-efdeea42e597 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Refreshing network info cache for port decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Start _get_guest_xml network_info=[{"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '33cbcfd9-c349-4c50-a3d9-7b9d8aca3776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 14:10:32 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:10:32 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:10:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] CPU controller missing on host. {{(pid=70914) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.host [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] CPU controller found on host. {{(pid=70914) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70914) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T13:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T13:28:34Z,direct_url=<?>,disk_format='qcow2',id=33cbcfd9-c349-4c50-a3d9-7b9d8aca3776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e48802ad24da44e8b3554f42c9496c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T13:28:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Flavor limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Image limits 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Flavor pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Image pref 0:0:0 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Got 1 possible topologies {{(pid=70914) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.hardware [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70914) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1753893704',display_name='tempest-TestServerVolumeAttachmentScenario-server-1753893704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1753893704',id=51,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg9NAukUtSix30gj4bqEQZ9tgBfBnU/StaSdPhp7xpjkNJ1xXO6nljWXkjVxOyaBPFdRUr5J5RRBthnm22+YQEbb0Fd8CltOoMITIi7FNHiWMReSWFhHXvjrfMO7e1QdQ==',key_name='tempest-keypair-1623692363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99080d53a44d4aafb4db49b58007653e',ramdisk_id='',reservation_id='r-9jnxqxvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1123819080',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1123819080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='224a0c3b1ac7497b874c68eb18048d0f',uuid=24d311bc-2e9b-4bc6-9ede-3d38620d4157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70914) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Converting VIF {"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:74:ff,bridge_name='br-int',has_traffic_filtering=True,id=decc6867-e855-477d-b786-e39d0e8e4b02,network=Network(c9519a4e-63c2-4de4-8bb5-4882ce318381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecc6867-e8') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.objects.instance [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lazy-loading 'pci_devices' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] End _get_guest_xml xml=<domain type="kvm">
Jul 27 14:10:32 user nova-compute[70914]:   <uuid>24d311bc-2e9b-4bc6-9ede-3d38620d4157</uuid>
Jul 27 14:10:32 user nova-compute[70914]:   <name>instance-00000033</name>
Jul 27 14:10:32 user nova-compute[70914]:   <memory>524288</memory>
Jul 27 14:10:32 user nova-compute[70914]:   <vcpu>1</vcpu>
Jul 27 14:10:32 user nova-compute[70914]:   <metadata>
Jul 27 14:10:32 user nova-compute[70914]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 14:10:32 user nova-compute[70914]:       <nova:package version="0.0.0"/>
Jul 27 14:10:32 user nova-compute[70914]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1753893704</nova:name>
Jul 27 14:10:32 user nova-compute[70914]:       <nova:creationTime>2023-07-27 14:10:32</nova:creationTime>
Jul 27 14:10:32 user nova-compute[70914]:       <nova:flavor name="m1.tiny">
Jul 27 14:10:32 user nova-compute[70914]:         <nova:memory>512</nova:memory>
Jul 27 14:10:32 user nova-compute[70914]:         <nova:disk>1</nova:disk>
Jul 27 14:10:32 user nova-compute[70914]:         <nova:swap>0</nova:swap>
Jul 27 14:10:32 user nova-compute[70914]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 14:10:32 user nova-compute[70914]:         <nova:vcpus>1</nova:vcpus>
Jul 27 14:10:32 user nova-compute[70914]:       </nova:flavor>
Jul 27 14:10:32 user nova-compute[70914]:       <nova:owner>
Jul 27 14:10:32 user nova-compute[70914]:         <nova:user uuid="224a0c3b1ac7497b874c68eb18048d0f">tempest-TestServerVolumeAttachmentScenario-1123819080-project-member</nova:user>
Jul 27 14:10:32 user nova-compute[70914]:         <nova:project uuid="99080d53a44d4aafb4db49b58007653e">tempest-TestServerVolumeAttachmentScenario-1123819080</nova:project>
Jul 27 14:10:32 user nova-compute[70914]:       </nova:owner>
Jul 27 14:10:32 user nova-compute[70914]:       <nova:root type="image" uuid="33cbcfd9-c349-4c50-a3d9-7b9d8aca3776"/>
Jul 27 14:10:32 user nova-compute[70914]:       <nova:ports>
Jul 27 14:10:32 user nova-compute[70914]:         <nova:port uuid="decc6867-e855-477d-b786-e39d0e8e4b02">
Jul 27 14:10:32 user nova-compute[70914]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 14:10:32 user nova-compute[70914]:         </nova:port>
Jul 27 14:10:32 user nova-compute[70914]:       </nova:ports>
Jul 27 14:10:32 user nova-compute[70914]:     </nova:instance>
Jul 27 14:10:32 user nova-compute[70914]:   </metadata>
Jul 27 14:10:32 user nova-compute[70914]:   <sysinfo type="smbios">
Jul 27 14:10:32 user nova-compute[70914]:     <system>
Jul 27 14:10:32 user nova-compute[70914]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 14:10:32 user nova-compute[70914]:       <entry name="product">OpenStack Nova</entry>
Jul 27 14:10:32 user nova-compute[70914]:       <entry name="version">0.0.0</entry>
Jul 27 14:10:32 user nova-compute[70914]:       <entry name="serial">24d311bc-2e9b-4bc6-9ede-3d38620d4157</entry>
Jul 27 14:10:32 user nova-compute[70914]:       <entry name="uuid">24d311bc-2e9b-4bc6-9ede-3d38620d4157</entry>
Jul 27 14:10:32 user nova-compute[70914]:       <entry name="family">Virtual Machine</entry>
Jul 27 14:10:32 user nova-compute[70914]:     </system>
Jul 27 14:10:32 user nova-compute[70914]:   </sysinfo>
Jul 27 14:10:32 user nova-compute[70914]:   <os>
Jul 27 14:10:32 user nova-compute[70914]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 14:10:32 user nova-compute[70914]:     <boot dev="hd"/>
Jul 27 14:10:32 user nova-compute[70914]:     <smbios mode="sysinfo"/>
Jul 27 14:10:32 user nova-compute[70914]:   </os>
Jul 27 14:10:32 user nova-compute[70914]:   <features>
Jul 27 14:10:32 user nova-compute[70914]:     <acpi/>
Jul 27 14:10:32 user nova-compute[70914]:     <apic/>
Jul 27 14:10:32 user nova-compute[70914]:     <vmcoreinfo/>
Jul 27 14:10:32 user nova-compute[70914]:   </features>
Jul 27 14:10:32 user nova-compute[70914]:   <clock offset="utc">
Jul 27 14:10:32 user nova-compute[70914]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 14:10:32 user nova-compute[70914]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 14:10:32 user nova-compute[70914]:     <timer name="hpet" present="no"/>
Jul 27 14:10:32 user nova-compute[70914]:   </clock>
Jul 27 14:10:32 user nova-compute[70914]:   <cpu mode="custom" match="exact">
Jul 27 14:10:32 user nova-compute[70914]:     <model>Nehalem</model>
Jul 27 14:10:32 user nova-compute[70914]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 14:10:32 user nova-compute[70914]:   </cpu>
Jul 27 14:10:32 user nova-compute[70914]:   <devices>
Jul 27 14:10:32 user nova-compute[70914]:     <disk type="file" device="disk">
Jul 27 14:10:32 user nova-compute[70914]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 14:10:32 user nova-compute[70914]:       <source file="/opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk"/>
Jul 27 14:10:32 user nova-compute[70914]:       <target dev="vda" bus="virtio"/>
Jul 27 14:10:32 user nova-compute[70914]:     </disk>
Jul 27 14:10:32 user nova-compute[70914]:     <interface type="ethernet">
Jul 27 14:10:32 user nova-compute[70914]:       <mac address="fa:16:3e:90:74:ff"/>
Jul 27 14:10:32 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:10:32 user nova-compute[70914]:       <mtu size="1442"/>
Jul 27 14:10:32 user nova-compute[70914]:       <target dev="tapdecc6867-e8"/>
Jul 27 14:10:32 user nova-compute[70914]:     </interface>
Jul 27 14:10:32 user nova-compute[70914]:     <serial type="pty">
Jul 27 14:10:32 user nova-compute[70914]:       <log file="/opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/console.log" append="off"/>
Jul 27 14:10:32 user nova-compute[70914]:     </serial>
Jul 27 14:10:32 user nova-compute[70914]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 14:10:32 user nova-compute[70914]:     <video>
Jul 27 14:10:32 user nova-compute[70914]:       <model type="virtio"/>
Jul 27 14:10:32 user nova-compute[70914]:     </video>
Jul 27 14:10:32 user nova-compute[70914]:     <rng model="virtio">
Jul 27 14:10:32 user nova-compute[70914]:       <backend model="random">/dev/urandom</backend>
Jul 27 14:10:32 user nova-compute[70914]:     </rng>
Jul 27 14:10:32 user nova-compute[70914]:     <controller type="usb" index="0" model="none"/>
Jul 27 14:10:32 user nova-compute[70914]:     <memballoon model="virtio">
Jul 27 14:10:32 user nova-compute[70914]:       <stats period="10"/>
Jul 27 14:10:32 user nova-compute[70914]:     </memballoon>
Jul 27 14:10:32 user nova-compute[70914]:   </devices>
Jul 27 14:10:32 user nova-compute[70914]: </domain>
Jul 27 14:10:32 user nova-compute[70914]:  {{(pid=70914) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1753893704',display_name='tempest-TestServerVolumeAttachmentScenario-server-1753893704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1753893704',id=51,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg9NAukUtSix30gj4bqEQZ9tgBfBnU/StaSdPhp7xpjkNJ1xXO6nljWXkjVxOyaBPFdRUr5J5RRBthnm22+YQEbb0Fd8CltOoMITIi7FNHiWMReSWFhHXvjrfMO7e1QdQ==',key_name='tempest-keypair-1623692363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99080d53a44d4aafb4db49b58007653e',ramdisk_id='',reservation_id='r-9jnxqxvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1123819080',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1123819080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T14:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='224a0c3b1ac7497b874c68eb18048d0f',uuid=24d311bc-2e9b-4bc6-9ede-3d38620d4157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Converting VIF {"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:74:ff,bridge_name='br-int',has_traffic_filtering=True,id=decc6867-e855-477d-b786-e39d0e8e4b02,network=Network(c9519a4e-63c2-4de4-8bb5-4882ce318381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecc6867-e8') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG os_vif [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:74:ff,bridge_name='br-int',has_traffic_filtering=True,id=decc6867-e855-477d-b786-e39d0e8e4b02,network=Network(c9519a4e-63c2-4de4-8bb5-4882ce318381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecc6867-e8') {{(pid=70914) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdecc6867-e8, may_exist=True, interface_attrs={}) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdecc6867-e8, col_values=(('external_ids', {'iface-id': 'decc6867-e855-477d-b786-e39d0e8e4b02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:74:ff', 'vm-uuid': '24d311bc-2e9b-4bc6-9ede-3d38620d4157'}),), if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:32 user nova-compute[70914]: INFO os_vif [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:74:ff,bridge_name='br-int',has_traffic_filtering=True,id=decc6867-e855-477d-b786-e39d0e8e4b02,network=Network(c9519a4e-63c2-4de4-8bb5-4882ce318381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecc6867-e8')
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:10:32 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] No VIF found with MAC fa:16:3e:90:74:ff, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:10:33 user nova-compute[70914]: DEBUG nova.network.neutron [req-90158879-b95c-492a-b0d9-d0735d4a8fa5 req-b58245e9-9b42-4f3a-acbf-efdeea42e597 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updated VIF entry in instance network info cache for port decc6867-e855-477d-b786-e39d0e8e4b02. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:10:33 user nova-compute[70914]: DEBUG nova.network.neutron [req-90158879-b95c-492a-b0d9-d0735d4a8fa5 req-b58245e9-9b42-4f3a-acbf-efdeea42e597 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updating instance_info_cache with network_info: [{"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:10:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-90158879-b95c-492a-b0d9-d0735d4a8fa5 req-b58245e9-9b42-4f3a-acbf-efdeea42e597 service nova] Releasing lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-50020f0e-4787-48a6-87e2-af8ce90c91e2 req-7c75fe70-9a8e-443f-8b09-60a1eb34f392 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received event network-vif-plugged-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-50020f0e-4787-48a6-87e2-af8ce90c91e2 req-7c75fe70-9a8e-443f-8b09-60a1eb34f392 service nova] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-50020f0e-4787-48a6-87e2-af8ce90c91e2 req-7c75fe70-9a8e-443f-8b09-60a1eb34f392 service nova] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-50020f0e-4787-48a6-87e2-af8ce90c91e2 req-7c75fe70-9a8e-443f-8b09-60a1eb34f392 service nova] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG nova.compute.manager [req-50020f0e-4787-48a6-87e2-af8ce90c91e2 req-7c75fe70-9a8e-443f-8b09-60a1eb34f392 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] No waiting events found dispatching network-vif-plugged-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:10:34 user nova-compute[70914]: WARNING nova.compute.manager [req-50020f0e-4787-48a6-87e2-af8ce90c91e2 req-7c75fe70-9a8e-443f-8b09-60a1eb34f392 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received unexpected event network-vif-plugged-decc6867-e855-477d-b786-e39d0e8e4b02 for instance with vm_state building and task_state spawning.
Jul 27 14:10:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-bbd09320-aff2-4b6c-ac7d-5370e88cfa3d req-4a4d2bba-44d3-409c-83f9-8205f20528a0 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received event network-changed-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:10:35 user nova-compute[70914]: DEBUG nova.compute.manager [req-bbd09320-aff2-4b6c-ac7d-5370e88cfa3d req-4a4d2bba-44d3-409c-83f9-8205f20528a0 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Refreshing instance network info cache due to event network-changed-ecaebd7e-86ae-46a0-8e70-151d69e72fc6. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:10:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bbd09320-aff2-4b6c-ac7d-5370e88cfa3d req-4a4d2bba-44d3-409c-83f9-8205f20528a0 service nova] Acquiring lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:10:35 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bbd09320-aff2-4b6c-ac7d-5370e88cfa3d req-4a4d2bba-44d3-409c-83f9-8205f20528a0 service nova] Acquired lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:10:35 user nova-compute[70914]: DEBUG nova.network.neutron [req-bbd09320-aff2-4b6c-ac7d-5370e88cfa3d req-4a4d2bba-44d3-409c-83f9-8205f20528a0 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Refreshing network info cache for port ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690467036.367043, 24d311bc-2e9b-4bc6-9ede-3d38620d4157 => Resumed> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:10:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] VM Resumed (Lifecycle Event)
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Instance event wait completed in 0 seconds for  {{(pid=70914) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Guest created on hypervisor {{(pid=70914) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 14:10:36 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Instance spawned successfully.
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Found default for hw_cdrom_bus of ide {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Found default for hw_disk_bus of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Found default for hw_input_bus of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Found default for hw_pointer_model of None {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Found default for hw_video_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Found default for hw_vif_model of virtio {{(pid=70914) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 14:10:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.virt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Emitting event <LifecycleEvent: 1690467036.3729334, 24d311bc-2e9b-4bc6-9ede-3d38620d4157 => Started> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:10:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] VM Started (Lifecycle Event)
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70914) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 14:10:36 user nova-compute[70914]: INFO nova.compute.manager [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.network.neutron [req-bbd09320-aff2-4b6c-ac7d-5370e88cfa3d req-4a4d2bba-44d3-409c-83f9-8205f20528a0 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updated VIF entry in instance network info cache for port ecaebd7e-86ae-46a0-8e70-151d69e72fc6. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.network.neutron [req-bbd09320-aff2-4b6c-ac7d-5370e88cfa3d req-4a4d2bba-44d3-409c-83f9-8205f20528a0 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updating instance_info_cache with network_info: [{"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:10:36 user nova-compute[70914]: INFO nova.compute.manager [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Took 5.68 seconds to spawn the instance on the hypervisor.
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.compute.manager [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-bbd09320-aff2-4b6c-ac7d-5370e88cfa3d req-4a4d2bba-44d3-409c-83f9-8205f20528a0 service nova] Releasing lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-0c5ae9ab-ee09-4217-aacc-5e00c05d5a7b req-956df165-a36d-43dc-9b8f-2a9fbfc5dfbd service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received event network-vif-plugged-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0c5ae9ab-ee09-4217-aacc-5e00c05d5a7b req-956df165-a36d-43dc-9b8f-2a9fbfc5dfbd service nova] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0c5ae9ab-ee09-4217-aacc-5e00c05d5a7b req-956df165-a36d-43dc-9b8f-2a9fbfc5dfbd service nova] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-0c5ae9ab-ee09-4217-aacc-5e00c05d5a7b req-956df165-a36d-43dc-9b8f-2a9fbfc5dfbd service nova] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:36 user nova-compute[70914]: DEBUG nova.compute.manager [req-0c5ae9ab-ee09-4217-aacc-5e00c05d5a7b req-956df165-a36d-43dc-9b8f-2a9fbfc5dfbd service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] No waiting events found dispatching network-vif-plugged-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:10:36 user nova-compute[70914]: WARNING nova.compute.manager [req-0c5ae9ab-ee09-4217-aacc-5e00c05d5a7b req-956df165-a36d-43dc-9b8f-2a9fbfc5dfbd service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received unexpected event network-vif-plugged-decc6867-e855-477d-b786-e39d0e8e4b02 for instance with vm_state building and task_state spawning.
Jul 27 14:10:36 user nova-compute[70914]: INFO nova.compute.manager [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Took 6.26 seconds to build instance.
Jul 27 14:10:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-96d526a7-5385-438d-a4c3-d8689fd25b6f tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.363s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:37 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "0b36bcfb-0397-4560-9db0-467ba39df327" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0b36bcfb-0397-4560-9db0-467ba39df327" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:38 user nova-compute[70914]: INFO nova.compute.manager [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Terminating instance
Jul 27 14:10:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received event network-changed-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Refreshing instance network info cache due to event network-changed-ecaebd7e-86ae-46a0-8e70-151d69e72fc6. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] Acquiring lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] Acquired lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG nova.network.neutron [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Refreshing network info cache for port ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:10:38 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Instance destroyed successfully.
Jul 27 14:10:38 user nova-compute[70914]: DEBUG nova.objects.instance [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'resources' on Instance uuid 0b36bcfb-0397-4560-9db0-467ba39df327 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1893269946',display_name='tempest-TestVolumeBootPattern-server-1893269946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1893269946',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTIlETEzrlhBz6OePq01eKR0vcasXvXhxqFCkGLx2Csd5vC2HyUqXiG76OOALVAFV1uvdeTYYEQFTuaa0BMfwlQOyATH6cj50OJFdi8LwK7LlbSEfvUgqiY4m0oMQIcqg==',key_name='tempest-TestVolumeBootPattern-1266066309',keypairs=<?>,launch_index=0,launched_at=2023-07-27T14:08:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-kn3hop81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T14:08:56Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=0b36bcfb-0397-4560-9db0-467ba39df327,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:da:e6,bridge_name='br-int',has_traffic_filtering=True,id=ecaebd7e-86ae-46a0-8e70-151d69e72fc6,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecaebd7e-86') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_vif [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:da:e6,bridge_name='br-int',has_traffic_filtering=True,id=ecaebd7e-86ae-46a0-8e70-151d69e72fc6,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecaebd7e-86') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecaebd7e-86, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:10:38 user nova-compute[70914]: INFO os_vif [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:da:e6,bridge_name='br-int',has_traffic_filtering=True,id=ecaebd7e-86ae-46a0-8e70-151d69e72fc6,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecaebd7e-86')
Jul 27 14:10:38 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPMRJACs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:10:38 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f9a327-5250-4bbd-8bde-77f7315d83f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:10:38 user nova-compute[70914]: No targets found.
Jul 27 14:10:38 user nova-compute[70914]: iSNS:
Jul 27 14:10:38 user nova-compute[70914]: No targets found.
Jul 27 14:10:38 user nova-compute[70914]: STATIC:
Jul 27 14:10:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2
Jul 27 14:10:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:10:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:10:38 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5
Jul 27 14:10:38 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:10:38 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:10:38 user nova-compute[70914]: FIRMWARE:
Jul 27 14:10:38 user nova-compute[70914]: No targets found.
Jul 27 14:10:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:10:38 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:10:38 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adcefdf-f2e4-401c-ba93-7c2e8f358ecd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c899bc-99b4-49be-ab56-da67bdeadef2]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:10:38 user nova-compute[70914]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 (non-flash)
Jul 27 14:10:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:10:38 user nova-compute[70914]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 (non-flash)
Jul 27 14:10:38 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c181a16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5'): ({'sdc'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Removing single pathed devices sdc {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[981317cc-4af1-44a2-931c-bf64c989ec85]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:38 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[df56b272-e7aa-42cf-a415-3182c6542d92]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flushing IO for device /dev/sdc {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f18c7-341d-463b-a72e-027e223b0158]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2673a987-c145-4925-8dff-e174ea3ce706]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26561643333636438', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f51a880c', '/dev/disk/by-id/scsi-1SCST_BIOf51a880c-ead33cd84c0d324b') {{(pid=82182) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[20299dea-d1a7-48f5-a883-12717b83ee2f]: (4, None) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ece84a-92bd-4b71-83f3-135620ad46c7]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a934f6d8-4baf-4b0c-a397-fc383029131b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5, portal: 172.16.0.220,3260]
Jul 27 14:10:39 user nova-compute[70914]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5, portal: 172.16.0.220,3260] successful.
Jul 27 14:10:39 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab811e2-fd92-47d3-98e7-6ffc550480d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8533021-77dc-47f6-be88-444bad5034a5]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== disconnect_volume: return (346ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:10:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Deleting instance files /opt/stack/data/nova/instances/0b36bcfb-0397-4560-9db0-467ba39df327_del
Jul 27 14:10:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Deletion of /opt/stack/data/nova/instances/0b36bcfb-0397-4560-9db0-467ba39df327_del complete
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updated VIF entry in instance network info cache for port ecaebd7e-86ae-46a0-8e70-151d69e72fc6. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updating instance_info_cache with network_info: [{"id": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "address": "fa:16:3e:97:da:e6", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecaebd7e-86", "ovs_interfaceid": "ecaebd7e-86ae-46a0-8e70-151d69e72fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] Releasing lock "refresh_cache-0b36bcfb-0397-4560-9db0-467ba39df327" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received event network-vif-unplugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] Acquiring lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] Lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] Lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] No waiting events found dispatching network-vif-unplugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-77c7a5ff-accb-485a-ab7c-ada98dab2865 req-1a1d3aed-086c-4e34-b5a0-572d8e2f54c3 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received event network-vif-unplugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:10:39 user nova-compute[70914]: INFO nova.compute.manager [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 27 14:10:39 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:10:39 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Took 0.54 seconds to deallocate network for instance.
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-60fdeaf5-f808-4a0c-a861-4ab3f206beda req-3f716019-fa9c-4a88-9bae-afbcc122a3ff service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received event network-vif-deleted-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:10:39 user nova-compute[70914]: INFO nova.compute.manager [req-60fdeaf5-f808-4a0c-a861-4ab3f206beda req-3f716019-fa9c-4a88-9bae-afbcc122a3ff service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Neutron deleted interface ecaebd7e-86ae-46a0-8e70-151d69e72fc6; detaching it from the instance and deleting it from the info cache
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.network.neutron [req-60fdeaf5-f808-4a0c-a861-4ab3f206beda req-3f716019-fa9c-4a88-9bae-afbcc122a3ff service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG nova.compute.manager [req-60fdeaf5-f808-4a0c-a861-4ab3f206beda req-3f716019-fa9c-4a88-9bae-afbcc122a3ff service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Detach interface failed, port_id=ecaebd7e-86ae-46a0-8e70-151d69e72fc6, reason: Instance 0b36bcfb-0397-4560-9db0-467ba39df327 could not be found. {{(pid=70914) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 14:10:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:40 user nova-compute[70914]: INFO nova.compute.manager [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Took 0.73 seconds to detach 1 volumes for instance.
Jul 27 14:10:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-463e70c2-cc55-4297-99a8-439111501c2d req-5aae4c6e-57fa-440e-b703-d8b921e64ad9 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received event network-vif-plugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:10:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-463e70c2-cc55-4297-99a8-439111501c2d req-5aae4c6e-57fa-440e-b703-d8b921e64ad9 service nova] Acquiring lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:10:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-463e70c2-cc55-4297-99a8-439111501c2d req-5aae4c6e-57fa-440e-b703-d8b921e64ad9 service nova] Lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:10:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-463e70c2-cc55-4297-99a8-439111501c2d req-5aae4c6e-57fa-440e-b703-d8b921e64ad9 service nova] Lock "0b36bcfb-0397-4560-9db0-467ba39df327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-463e70c2-cc55-4297-99a8-439111501c2d req-5aae4c6e-57fa-440e-b703-d8b921e64ad9 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] No waiting events found dispatching network-vif-plugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:10:40 user nova-compute[70914]: WARNING nova.compute.manager [req-463e70c2-cc55-4297-99a8-439111501c2d req-5aae4c6e-57fa-440e-b703-d8b921e64ad9 service nova] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Received unexpected event network-vif-plugged-ecaebd7e-86ae-46a0-8e70-151d69e72fc6 for instance with vm_state deleted and task_state None.
Jul 27 14:10:40 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:10:40 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:10:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:40 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Deleted allocations for instance 0b36bcfb-0397-4560-9db0-467ba39df327
Jul 27 14:10:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-876435d2-d462-4b29-948f-c416d818c8dc tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "0b36bcfb-0397-4560-9db0-467ba39df327" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.982s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:10:43 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:48 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:53 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690467038.8121722, 0b36bcfb-0397-4560-9db0-467ba39df327 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:10:53 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] VM Stopped (Lifecycle Event)
Jul 27 14:10:53 user nova-compute[70914]: DEBUG nova.compute.manager [None req-f48b5399-68d1-49e6-a35e-1e569ad1d202 None None] [instance: 0b36bcfb-0397-4560-9db0-467ba39df327] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:10:53 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:58 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:10:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:11:03 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:07 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:11:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:11:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:11:07 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:11:07 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:11:07 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:11:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:07 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:08 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:11:08 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:11:08 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=25.23248291015625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 6b79f962-6eec-411d-8b07-af448df4a52f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:11:08 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:10 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:11:10 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:11:12 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:11:12 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:11:13 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:11:14 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:11:15 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:11:17 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:11:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:11:17 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 14:11:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:11:17 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:11:17 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:11:17 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 6b79f962-6eec-411d-8b07-af448df4a52f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:11:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updating instance_info_cache with network_info: [{"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:11:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:11:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:11:18 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:11:18 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:23 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:28 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:11:33 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-ab98537d-0f3a-4e3c-9e7c-0895cc325515 req-b5500509-3ee4-495a-a33c-777d9adbf030 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received event network-changed-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-ab98537d-0f3a-4e3c-9e7c-0895cc325515 req-b5500509-3ee4-495a-a33c-777d9adbf030 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Refreshing instance network info cache due to event network-changed-fefd93d8-5647-4359-b062-af773a1b1855. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ab98537d-0f3a-4e3c-9e7c-0895cc325515 req-b5500509-3ee4-495a-a33c-777d9adbf030 service nova] Acquiring lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ab98537d-0f3a-4e3c-9e7c-0895cc325515 req-b5500509-3ee4-495a-a33c-777d9adbf030 service nova] Acquired lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG nova.network.neutron [req-ab98537d-0f3a-4e3c-9e7c-0895cc325515 req-b5500509-3ee4-495a-a33c-777d9adbf030 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Refreshing network info cache for port fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "6b79f962-6eec-411d-8b07-af448df4a52f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "6b79f962-6eec-411d-8b07-af448df4a52f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:11:38 user nova-compute[70914]: INFO nova.compute.manager [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Terminating instance
Jul 27 14:11:38 user nova-compute[70914]: DEBUG nova.compute.manager [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-d3675eda-069d-4882-95c5-b4ff29c3f0d0 req-cef2c7f3-b29d-4b02-9f22-82fe3bc9b707 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received event network-vif-unplugged-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d3675eda-069d-4882-95c5-b4ff29c3f0d0 req-cef2c7f3-b29d-4b02-9f22-82fe3bc9b707 service nova] Acquiring lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d3675eda-069d-4882-95c5-b4ff29c3f0d0 req-cef2c7f3-b29d-4b02-9f22-82fe3bc9b707 service nova] Lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-d3675eda-069d-4882-95c5-b4ff29c3f0d0 req-cef2c7f3-b29d-4b02-9f22-82fe3bc9b707 service nova] Lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-d3675eda-069d-4882-95c5-b4ff29c3f0d0 req-cef2c7f3-b29d-4b02-9f22-82fe3bc9b707 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] No waiting events found dispatching network-vif-unplugged-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG nova.compute.manager [req-d3675eda-069d-4882-95c5-b4ff29c3f0d0 req-cef2c7f3-b29d-4b02-9f22-82fe3bc9b707 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received event network-vif-unplugged-fefd93d8-5647-4359-b062-af773a1b1855 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG nova.network.neutron [req-ab98537d-0f3a-4e3c-9e7c-0895cc325515 req-b5500509-3ee4-495a-a33c-777d9adbf030 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updated VIF entry in instance network info cache for port fefd93d8-5647-4359-b062-af773a1b1855. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG nova.network.neutron [req-ab98537d-0f3a-4e3c-9e7c-0895cc325515 req-b5500509-3ee4-495a-a33c-777d9adbf030 service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updating instance_info_cache with network_info: [{"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:11:38 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-ab98537d-0f3a-4e3c-9e7c-0895cc325515 req-b5500509-3ee4-495a-a33c-777d9adbf030 service nova] Releasing lock "refresh_cache-6b79f962-6eec-411d-8b07-af448df4a52f" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:11:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Instance destroyed successfully.
Jul 27 14:11:39 user nova-compute[70914]: DEBUG nova.objects.instance [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lazy-loading 'resources' on Instance uuid 6b79f962-6eec-411d-8b07-af448df4a52f {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-251238654',display_name='tempest-TestVolumeBootPattern-server-251238654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-251238654',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTIlETEzrlhBz6OePq01eKR0vcasXvXhxqFCkGLx2Csd5vC2HyUqXiG76OOALVAFV1uvdeTYYEQFTuaa0BMfwlQOyATH6cj50OJFdi8LwK7LlbSEfvUgqiY4m0oMQIcqg==',key_name='tempest-TestVolumeBootPattern-1266066309',keypairs=<?>,launch_index=0,launched_at=2023-07-27T14:06:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c73ac071233d44fbb62e558725f63ef8',ramdisk_id='',reservation_id='r-kcl5ooel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1923193575',owner_user_name='tempest-TestVolumeBootPattern-1923193575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T14:06:51Z,user_data=None,user_id='b6161b1cf5fb4d08a8cbd36a93b8400c',uuid=6b79f962-6eec-411d-8b07-af448df4a52f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converting VIF {"id": "fefd93d8-5647-4359-b062-af773a1b1855", "address": "fa:16:3e:9e:6c:55", "network": {"id": "f9a6eca5-9f33-44c9-97c4-3fde819283c6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1276142216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c73ac071233d44fbb62e558725f63ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfefd93d8-56", "ovs_interfaceid": "fefd93d8-5647-4359-b062-af773a1b1855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6c:55,bridge_name='br-int',has_traffic_filtering=True,id=fefd93d8-5647-4359-b062-af773a1b1855,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfefd93d8-56') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_vif [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6c:55,bridge_name='br-int',has_traffic_filtering=True,id=fefd93d8-5647-4359-b062-af773a1b1855,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfefd93d8-56') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfefd93d8-56, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:11:39 user nova-compute[70914]: INFO os_vif [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6c:55,bridge_name='br-int',has_traffic_filtering=True,id=fefd93d8-5647-4359-b062-af773a1b1855,network=Network(f9a6eca5-9f33-44c9-97c4-3fde819283c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfefd93d8-56')
Jul 27 14:11:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOSsjWMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:11:39 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aa559e-2cff-47dc-9ccc-9eb8c6fad2f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:11:39 user nova-compute[70914]: No targets found.
Jul 27 14:11:39 user nova-compute[70914]: iSNS:
Jul 27 14:11:39 user nova-compute[70914]: No targets found.
Jul 27 14:11:39 user nova-compute[70914]: STATIC:
Jul 27 14:11:39 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2
Jul 27 14:11:39 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:11:39 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:11:39 user nova-compute[70914]: FIRMWARE:
Jul 27 14:11:39 user nova-compute[70914]: No targets found.
Jul 27 14:11:39 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:11:39 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:11:39 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f5aa1b-09d7-4ba9-ad9d-810e5c41b3d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87de0b6-8668-405e-8c0d-4f2253d7b7c8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:11:39 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 (non-flash)
Jul 27 14:11:39 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf85a9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce49bfc-e4f4-4f25-b7c5-e03e38db2f3f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[79164699-1300-402c-b4bd-2a62fa1ac2c0]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0949426a-4323-4727-8721-692ac965b814]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6f2c86-ba07-45ba-96e1-3d80bcc43a57]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b1379572', '/dev/disk/by-id/scsi-23239333939393136', '/dev/disk/by-id/scsi-1SCST_BIOb1379572-2939991605889c49') {{(pid=82182) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28d471d-f727-43cb-a343-ba66b6110655]: (4, None) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ed5354-b877-48cc-a1a3-9cd1bba8a553]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ee2487-02c2-478f-be00-79662f22a739]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260]
Jul 27 14:11:39 user nova-compute[70914]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2, portal: 172.16.0.220,3260] successful.
Jul 27 14:11:39 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1270a3-c982-4904-98e9-c5140f6241a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[003ed7c9-403c-4276-8460-7a36def5eeef]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] <== disconnect_volume: return (313ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:11:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Deleting instance files /opt/stack/data/nova/instances/6b79f962-6eec-411d-8b07-af448df4a52f_del
Jul 27 14:11:39 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Deletion of /opt/stack/data/nova/instances/6b79f962-6eec-411d-8b07-af448df4a52f_del complete
Jul 27 14:11:39 user nova-compute[70914]: INFO nova.compute.manager [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 27 14:11:39 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:11:39 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:11:40 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:11:40 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Took 0.83 seconds to deallocate network for instance.
Jul 27 14:11:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-a6d9110d-0ee8-4e41-990d-b966e6d34d11 req-4b7aedb9-8633-4b4e-b940-af8511d9ccfe service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received event network-vif-plugged-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:11:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a6d9110d-0ee8-4e41-990d-b966e6d34d11 req-4b7aedb9-8633-4b4e-b940-af8511d9ccfe service nova] Acquiring lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:11:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a6d9110d-0ee8-4e41-990d-b966e6d34d11 req-4b7aedb9-8633-4b4e-b940-af8511d9ccfe service nova] Lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:11:40 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-a6d9110d-0ee8-4e41-990d-b966e6d34d11 req-4b7aedb9-8633-4b4e-b940-af8511d9ccfe service nova] Lock "6b79f962-6eec-411d-8b07-af448df4a52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:11:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-a6d9110d-0ee8-4e41-990d-b966e6d34d11 req-4b7aedb9-8633-4b4e-b940-af8511d9ccfe service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] No waiting events found dispatching network-vif-plugged-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:11:40 user nova-compute[70914]: WARNING nova.compute.manager [req-a6d9110d-0ee8-4e41-990d-b966e6d34d11 req-4b7aedb9-8633-4b4e-b940-af8511d9ccfe service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received unexpected event network-vif-plugged-fefd93d8-5647-4359-b062-af773a1b1855 for instance with vm_state active and task_state deleting.
Jul 27 14:11:40 user nova-compute[70914]: DEBUG nova.compute.manager [req-a6d9110d-0ee8-4e41-990d-b966e6d34d11 req-4b7aedb9-8633-4b4e-b940-af8511d9ccfe service nova] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Received event network-vif-deleted-fefd93d8-5647-4359-b062-af773a1b1855 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:11:41 user nova-compute[70914]: INFO nova.compute.manager [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Took 0.69 seconds to detach 1 volumes for instance.
Jul 27 14:11:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:11:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:11:41 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:11:41 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:11:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:11:41 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Deleted allocations for instance 6b79f962-6eec-411d-8b07-af448df4a52f
Jul 27 14:11:41 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-0c4ec07b-b6fb-4eec-8b9f-4c4eab4d5706 tempest-TestVolumeBootPattern-1923193575 tempest-TestVolumeBootPattern-1923193575-project-member] Lock "6b79f962-6eec-411d-8b07-af448df4a52f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:11:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:54 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690467099.0864444, 6b79f962-6eec-411d-8b07-af448df4a52f => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:11:54 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] VM Stopped (Lifecycle Event)
Jul 27 14:11:54 user nova-compute[70914]: DEBUG nova.compute.manager [None req-57e7a48c-dcba-473f-9770-268ce0be6d4a None None] [instance: 6b79f962-6eec-411d-8b07-af448df4a52f] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:11:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:11:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:11:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:11:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:11:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:11:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:02 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:09 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:10 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:12:10 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:12:10 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8724MB free_disk=25.231414794921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:12:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:12:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:12:10 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:12:10 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:12:10 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:12:10 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:12:10 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:12:10 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:12:10 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:12:13 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:13 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:14 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:14 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:14 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:12:15 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:18 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:12:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:12:18 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:12:18 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:12:19 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updating instance_info_cache with network_info: [{"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:12:19 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:12:19 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:12:19 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-cce9bc4b-b2bd-4104-a995-dd0a447502b8 req-d391e9c6-241f-40a3-be18-000a18fbbe68 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received event network-changed-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG nova.compute.manager [req-cce9bc4b-b2bd-4104-a995-dd0a447502b8 req-d391e9c6-241f-40a3-be18-000a18fbbe68 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Refreshing instance network info cache due to event network-changed-decc6867-e855-477d-b786-e39d0e8e4b02. {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cce9bc4b-b2bd-4104-a995-dd0a447502b8 req-d391e9c6-241f-40a3-be18-000a18fbbe68 service nova] Acquiring lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cce9bc4b-b2bd-4104-a995-dd0a447502b8 req-d391e9c6-241f-40a3-be18-000a18fbbe68 service nova] Acquired lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG nova.network.neutron [req-cce9bc4b-b2bd-4104-a995-dd0a447502b8 req-d391e9c6-241f-40a3-be18-000a18fbbe68 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Refreshing network info cache for port decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG nova.network.neutron [req-cce9bc4b-b2bd-4104-a995-dd0a447502b8 req-d391e9c6-241f-40a3-be18-000a18fbbe68 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updated VIF entry in instance network info cache for port decc6867-e855-477d-b786-e39d0e8e4b02. {{(pid=70914) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG nova.network.neutron [req-cce9bc4b-b2bd-4104-a995-dd0a447502b8 req-d391e9c6-241f-40a3-be18-000a18fbbe68 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updating instance_info_cache with network_info: [{"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-cce9bc4b-b2bd-4104-a995-dd0a447502b8 req-d391e9c6-241f-40a3-be18-000a18fbbe68 service nova] Releasing lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lazy-loading 'flavor' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:12:21 user nova-compute[70914]: INFO nova.compute.manager [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Attaching volume e0ede43a-1565-4a66-99e9-bddd2c4cacea to /dev/vdb
Jul 27 14:12:21 user nova-compute[70914]: DEBUG os_brick.utils [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9924d6-8d9a-4996-ba62-49fe537f26af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:21 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc79e79b-8a1a-40be-9bc2-66bbca8a9163]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8a88c-4aab-4073-a2f5-f723496e1537]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ebdb6-dc59-4e6a-82b6-dcd23a16084d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:12:22 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 14:12:22 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e5d2f-a87f-49b1-830c-cba772f471f6]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG os_brick.utils [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:12:22 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updating existing volume attachment record: 84129d4e-0f99-43cd-a8db-3e6b2836d2c9 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 14:12:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:12:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzgtsHnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:12:28 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:12:28 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:12:28 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[35befd07-a39b-4dea-b8c8-3ff19fde40c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 14:12:28 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[889bb2af-87fc-4a0c-a38e-0405f2acbed0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea] added
Jul 27 14:12:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9a7bc2-bdcd-4162-98cd-74583718bbf3]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[587b6b13-b21d-4f5a-8265-908afa16f017]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzgtsHnR {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzgtsHnR" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[27590cef-3d1c-42e4-99ae-f33329032cca]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DzgtsHnR'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba388bd-1dc9-47fe-9020-fca3b7c3d207]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9245cb4e-f0c9-48c3-afc1-1041491c095f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 14:12:28 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 14:12:28 user nova-compute[70914]:  {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:12:28 user nova-compute[70914]: WARNING os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 14:12:28 user nova-compute[70914]: 
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[890cdd9d-ebec-4261-8767-433dc8832f4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea, portal: 172.16.0.220,3260]
Jul 27 14:12:28 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea, portal: 172.16.0.220,3260] successful.
Jul 27 14:12:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3db757-2408-41b9-aa41-f44ddf8dbf2c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5544e18a-336c-496e-bb35-db353878d97f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)
Jul 27 14:12:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)
Jul 27 14:12:28 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3894a5b-12f0-4405-9b40-7a3be7e6acc0]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:12:28 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzgtsHnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 14:12:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:12:29 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23632303465333734', 'path': '/dev/sdb'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:12:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632303465333734', 'path': '/dev/sdb'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 14:12:29 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lazy-loading 'flavor' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:12:29 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 14:12:29 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:12:29 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 14:12:29 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:12:29 user nova-compute[70914]:   <serial>e0ede43a-1565-4a66-99e9-bddd2c4cacea</serial>
Jul 27 14:12:29 user nova-compute[70914]: </disk>
Jul 27 14:12:29 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 14:12:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:12:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:12:30 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] No VIF found with MAC fa:16:3e:90:74:ff, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:12:30 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c91a0577-0b0c-453c-8ef3-9fdbf15046ce tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.552s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:12:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:12:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:12:33 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lazy-loading 'flavor' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:12:33 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:12:34 user nova-compute[70914]: INFO nova.compute.manager [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Attaching volume 4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 to /dev/vdc
Jul 27 14:12:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG os_brick.utils [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc87aaa-137f-451e-84ed-3d40620dc612]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1739f23393d3\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c451ac3-5d48-428a-ab95-3e96e503dc5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c093be4a-fe93-4eac-a454-25cd80df78df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9cc698-821f-482c-a3bb-2ff87514e21f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Running cmd (subprocess): nvme version {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] 'nvme version' failed. Not Retrying. {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] nvme not present on system {{(pid=70914) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 14:12:34 user nova-compute[70914]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 14:12:34 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c86fc-8c64-4149-ab91-80bfc247820c]: (4, '') {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70914) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.lightos [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] LIGHTOS: no hostnqn found. {{(pid=70914) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG os_brick.utils [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1739f23393d3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:12:34 user nova-compute[70914]: DEBUG nova.virt.block_device [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updating existing volume attachment record: 65bd0a01-ff66-4cfb-928b-216c4c16d7d7 {{(pid=70914) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 14:12:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:40 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Calling os-brick to attach iSCSI Volume {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLBoRzgA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:12:41 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:12:41 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:12:41 user nova-compute[70914]: INFO os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a34869-506e-46cf-8952-838470ef0a7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 14:12:41 user nova-compute[70914]:  {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --interface default --op new {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d91ea5-92b6-4abd-9ecd-91ab4b2b0ee5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073] added\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073] added
Jul 27 14:12:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[185590c5-cc56-4763-b6f3-8e75dea307fe]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef643bd-a7c7-4521-973f-6aadeb4e8ba2]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLBoRzgA {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLBoRzgA" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[52da0bf8-53f4-4213-a8a3-639360c89b8f]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sLBoRzgA'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e75bbad-1a35-479b-9f1d-c983832d189d]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c245ac-d8ef-46e9-a38a-6c300f5ca684]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)
Jul 27 14:12:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)
Jul 27 14:12:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --login {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[d893fe88-d338-4494-8190-0cdc7aad0c02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073, portal: 172.16.0.220,3260]
Jul 27 14:12:41 user nova-compute[70914]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073, portal: 172.16.0.220,3260] successful.
Jul 27 14:12:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[783eb600-818a-4a46-8329-de58adaff357]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564100f-6e35-4509-af7b-9f386a68eef2]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)
Jul 27 14:12:41 user nova-compute[70914]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 (non-flash)
Jul 27 14:12:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)
Jul 27 14:12:41 user nova-compute[70914]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 (non-flash)
Jul 27 14:12:41 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Connected to 172.16.0.220:3260 {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=70914) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70914) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[7006ae92-a79f-4c14-a088-616c9d2d0bd2]: (4, ('- - 0', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70914) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 14:12:41 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLBoRzgA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70914) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 14:12:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:12:42 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26232626236313231', 'path': '/dev/sdc'} {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:12:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232626236313231', 'path': '/dev/sdc'} {{(pid=70914) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 14:12:42 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lazy-loading 'flavor' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:12:42 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 14:12:42 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:12:42 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 14:12:42 user nova-compute[70914]:   <target dev="vdc" bus="virtio"/>
Jul 27 14:12:42 user nova-compute[70914]:   <serial>4c7d56b7-ec68-405f-b4b6-e1d3cb25e073</serial>
Jul 27 14:12:42 user nova-compute[70914]: </disk>
Jul 27 14:12:42 user nova-compute[70914]:  {{(pid=70914) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 14:12:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] No BDM found with device name vda, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:12:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:12:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70914) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 14:12:43 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] No VIF found with MAC fa:16:3e:90:74:ff, not building metadata {{(pid=70914) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 14:12:43 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c1c2c4f0-c160-4ece-ab28-460790a8e497 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.132s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:12:44 user nova-compute[70914]: INFO nova.compute.manager [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Detaching volume 4c7d56b7-ec68-405f-b4b6-e1d3cb25e073
Jul 27 14:12:44 user nova-compute[70914]: INFO nova.virt.block_device [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Attempting to driver detach volume 4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 from mountpoint /dev/vdc
Jul 27 14:12:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Attempting to detach device vdc from instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:12:44 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:12:44 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 14:12:44 user nova-compute[70914]:   <target dev="vdc" bus="virtio"/>
Jul 27 14:12:44 user nova-compute[70914]:   <serial>4c7d56b7-ec68-405f-b4b6-e1d3cb25e073</serial>
Jul 27 14:12:44 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 14:12:44 user nova-compute[70914]: </disk>
Jul 27 14:12:44 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:12:44 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Successfully detached device vdc from instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 from the persistent domain config.
Jul 27 14:12:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:12:44 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:12:44 user nova-compute[70914]:   <source dev="/dev/sdc"/>
Jul 27 14:12:44 user nova-compute[70914]:   <target dev="vdc" bus="virtio"/>
Jul 27 14:12:44 user nova-compute[70914]:   <serial>4c7d56b7-ec68-405f-b4b6-e1d3cb25e073</serial>
Jul 27 14:12:44 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 14:12:44 user nova-compute[70914]: </disk>
Jul 27 14:12:44 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690467164.8006828, 24d311bc-2e9b-4bc6-9ede-3d38620d4157 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 14:12:44 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Successfully detached device vdc from instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 from the live domain config.
Jul 27 14:12:44 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLBoRzgA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:12:44 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[57af6478-8f8c-4451-94bc-05dbe5e0be57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:12:44 user nova-compute[70914]: No targets found.
Jul 27 14:12:44 user nova-compute[70914]: iSNS:
Jul 27 14:12:44 user nova-compute[70914]: No targets found.
Jul 27 14:12:44 user nova-compute[70914]: STATIC:
Jul 27 14:12:44 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea
Jul 27 14:12:44 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:12:44 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:12:44 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073
Jul 27 14:12:44 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:12:44 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:12:44 user nova-compute[70914]: FIRMWARE:
Jul 27 14:12:44 user nova-compute[70914]: No targets found.
Jul 27 14:12:44 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:12:44 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:12:44 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[75794eb0-3e76-434c-ac75-2485ebb04d13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e040024-af4b-455f-96c2-a4fc5ec43d1c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)
Jul 27 14:12:44 user nova-compute[70914]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 (non-flash)
Jul 27 14:12:44 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)
Jul 27 14:12:44 user nova-compute[70914]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 (non-flash)
Jul 27 14:12:44 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c181a3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073'): ({'sdc'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Removing single pathed devices sdc {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f361ed-e300-4e61-9ecf-cdc5dbdbd1f0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbc83b3-bb81-418b-96d0-99f24262ce75]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Flushing IO for device /dev/sdc {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d9f069-1f20-4a97-adb9-f7b4406d5239]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb8a1f8-45f0-4835-8c39-43ceafd7c709]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] SCSI volumes sdc have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:12:44 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b641c4-e9db-4b07-9e6f-158bc5a765b4]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b4965a-fd4b-45e9-95a1-eb4f341614d1]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073, portal: 172.16.0.220,3260]
Jul 27 14:12:45 user nova-compute[70914]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073, portal: 172.16.0.220,3260] successful.
Jul 27 14:12:45 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d56b7-ec68-405f-b4b6-e1d3cb25e073 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65d4d2c-1e9a-476e-90e3-5e4fbfdeebe0]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] <== disconnect_volume: return (293ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG nova.objects.instance [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lazy-loading 'flavor' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:12:45 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-c1930a56-059a-4a0c-ac56-2920f0812195 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.547s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:12:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:12:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:12:57 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:12:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 14:12:57 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] There are 0 instances to clean {{(pid=70914) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 14:12:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:13:03 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:13:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:13:10 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:11 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:13:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:13:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:13:11 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:13:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:12 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70914) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 14:13:12 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:13:12 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:13:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.229209899902344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:13:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:13:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:13:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:13:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:13:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:13:12 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:13:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:13:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:13:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:13:13 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:13:15 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:16 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:16 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:13:17 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:13:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:13:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:13:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:13:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:13:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:13:19 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:20 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:13:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 14:13:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:13:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:13:20 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:13:20 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:13:21 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updating instance_info_cache with network_info: [{"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:13:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:13:21 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:13:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:13:24 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:24 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Cleaning up deleted instances with incomplete migration  {{(pid=70914) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 14:13:29 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:13:29 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:13:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:13:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:13:34 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:13:34 user nova-compute[70914]: INFO nova.compute.manager [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Detaching volume e0ede43a-1565-4a66-99e9-bddd2c4cacea
Jul 27 14:13:34 user nova-compute[70914]: INFO nova.virt.block_device [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Attempting to driver detach volume e0ede43a-1565-4a66-99e9-bddd2c4cacea from mountpoint /dev/vdb
Jul 27 14:13:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Attempting to detach device vdb from instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 from the persistent domain config. {{(pid=70914) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 14:13:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:13:34 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:13:34 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 14:13:34 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:13:34 user nova-compute[70914]:   <serial>e0ede43a-1565-4a66-99e9-bddd2c4cacea</serial>
Jul 27 14:13:34 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 14:13:34 user nova-compute[70914]: </disk>
Jul 27 14:13:34 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:13:34 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Successfully detached device vdb from instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 from the persistent domain config.
Jul 27 14:13:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 from the live domain config. {{(pid=70914) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 14:13:34 user nova-compute[70914]: DEBUG nova.virt.libvirt.guest [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 14:13:34 user nova-compute[70914]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 14:13:34 user nova-compute[70914]:   <source dev="/dev/sdb"/>
Jul 27 14:13:34 user nova-compute[70914]:   <target dev="vdb" bus="virtio"/>
Jul 27 14:13:34 user nova-compute[70914]:   <serial>e0ede43a-1565-4a66-99e9-bddd2c4cacea</serial>
Jul 27 14:13:34 user nova-compute[70914]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 14:13:34 user nova-compute[70914]: </disk>
Jul 27 14:13:34 user nova-compute[70914]:  {{(pid=70914) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-056b1dcb-cf3a-4bf9-94eb-2c953b94014d None None] Received event <DeviceRemovedEvent: 1690467215.3531609, 24d311bc-2e9b-4bc6-9ede-3d38620d4157 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70914) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.driver [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 14:13:35 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Successfully detached device vdb from instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 from the live domain config.
Jul 27 14:13:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] calling os-brick to detach iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c18575090>, {'target_iqn': 'iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzgtsHnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 14:13:35 user nova-compute[70914]: WARNING os_brick.initiator.connectors.base [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca364d6-958a-420c-bf57-18f2633b5747]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 14:13:35 user nova-compute[70914]: No targets found.
Jul 27 14:13:35 user nova-compute[70914]: iSNS:
Jul 27 14:13:35 user nova-compute[70914]: No targets found.
Jul 27 14:13:35 user nova-compute[70914]: STATIC:
Jul 27 14:13:35 user nova-compute[70914]: Target: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea
Jul 27 14:13:35 user nova-compute[70914]:         Portal: 172.16.0.220:3260,-1
Jul 27 14:13:35 user nova-compute[70914]:                 Iface Name: default
Jul 27 14:13:35 user nova-compute[70914]: FIRMWARE:
Jul 27 14:13:35 user nova-compute[70914]: No targets found.
Jul 27 14:13:35 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 14:13:35 user nova-compute[70914]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 14:13:35 user nova-compute[70914]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70914) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea', 0)] {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[9368d378-6271-4eeb-a3e7-7bf21ea0f89b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0648ded-0c13-4fcf-8e81-27b22883b634]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)
Jul 27 14:13:35 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea (non-flash)
Jul 27 14:13:35 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c181a17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea'): ({'sdb'}, set())}) {{(pid=70914) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Removing single pathed devices sdb {{(pid=70914) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[1441af23-177f-4f0e-bdb2-94c611c5febd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[51de1109-91b8-4518-a765-ecf3c598e97c]: (4, ('ok\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Flushing IO for device /dev/sdb {{(pid=70914) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b74aeff-167e-4978-8c68-925364578dcf]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70914) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9d7c0d-d06a-4f48-955b-60190df4d185]: (4, ('1', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.linuxscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] SCSI volumes sdb have been removed. {{(pid=70914) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea')] {{(pid=70914) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[318856d9-c818-474c-838f-3f1ffd11e60c]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --logout {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aa7780-f8d6-419d-9789-e8611931ad03]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea, portal: 172.16.0.220,3260]
Jul 27 14:13:35 user nova-compute[70914]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea, portal: 172.16.0.220,3260] successful.
Jul 27 14:13:35 user nova-compute[70914]:  stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op delete {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ede43a-1565-4a66-99e9-bddd2c4cacea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82182) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG oslo.privsep.daemon [-] privsep: reply[807bf765-1e85-4a87-8827-991437279784]: (4, ('', '')) {{(pid=82182) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70914) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.base [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG os_brick.initiator.connectors.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] <== disconnect_volume: return (284ms) None {{(pid=70914) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 14:13:35 user nova-compute[70914]: DEBUG nova.virt.libvirt.volume.iscsi [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Disconnected iSCSI Volume {{(pid=70914) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 14:13:36 user nova-compute[70914]: DEBUG nova.objects.instance [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lazy-loading 'flavor' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:13:36 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-584340d5-3791-4317-bfb4-e2577ced3f87 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:13:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:13:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:13:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:13:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:13:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:13:39 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:13:44 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:13:49 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:13:54 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:13:59 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:14:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:04 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:05 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:14:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:14:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:09 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:11 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:14:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:14:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:14:11 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:14:11 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:14:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:14:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:14:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 14:14:11 user nova-compute[70914]: DEBUG oslo_concurrency.processutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70914) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 14:14:12 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:14:12 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.228530883789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70914) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Refreshing inventories for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Updating ProviderTree inventory for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Updating inventory in ProviderTree for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Refreshing aggregate associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, aggregates: None {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Refreshing trait associations for resource provider 28f9fcbc-7a25-483f-af71-8564174ecae0, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=70914) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:14:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:14:13 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:14:14 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:14 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:14:15 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:14:17 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:14:18 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:14:18 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:14:18 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:14:19 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:19 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:14:20 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:14:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:14:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 14:14:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 14:14:20 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquired lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 14:14:20 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Forcefully refreshing network info cache for instance {{(pid=70914) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 14:14:20 user nova-compute[70914]: DEBUG nova.objects.instance [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lazy-loading 'info_cache' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:14:21 user nova-compute[70914]: DEBUG nova.network.neutron [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updating instance_info_cache with network_info: [{"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:14:21 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Releasing lock "refresh_cache-24d311bc-2e9b-4bc6-9ede-3d38620d4157" {{(pid=70914) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 14:14:21 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updated the network info_cache for instance {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 14:14:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:14:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:24 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:14:25 user nova-compute[70914]: INFO nova.compute.manager [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Terminating instance
Jul 27 14:14:25 user nova-compute[70914]: DEBUG nova.compute.manager [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Start destroying the instance on the hypervisor. {{(pid=70914) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-8c5ba889-703e-4aea-a68b-489adf494404 req-951086b2-465c-4deb-999c-dd76071f4073 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received event network-vif-unplugged-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8c5ba889-703e-4aea-a68b-489adf494404 req-951086b2-465c-4deb-999c-dd76071f4073 service nova] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8c5ba889-703e-4aea-a68b-489adf494404 req-951086b2-465c-4deb-999c-dd76071f4073 service nova] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-8c5ba889-703e-4aea-a68b-489adf494404 req-951086b2-465c-4deb-999c-dd76071f4073 service nova] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-8c5ba889-703e-4aea-a68b-489adf494404 req-951086b2-465c-4deb-999c-dd76071f4073 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] No waiting events found dispatching network-vif-unplugged-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG nova.compute.manager [req-8c5ba889-703e-4aea-a68b-489adf494404 req-951086b2-465c-4deb-999c-dd76071f4073 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received event network-vif-unplugged-decc6867-e855-477d-b786-e39d0e8e4b02 for instance with task_state deleting. {{(pid=70914) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:25 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:25 user nova-compute[70914]: INFO nova.virt.libvirt.driver [-] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Instance destroyed successfully.
Jul 27 14:14:25 user nova-compute[70914]: DEBUG nova.objects.instance [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lazy-loading 'resources' on Instance uuid 24d311bc-2e9b-4bc6-9ede-3d38620d4157 {{(pid=70914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG nova.virt.libvirt.vif [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T14:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1753893704',display_name='tempest-TestServerVolumeAttachmentScenario-server-1753893704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1753893704',id=51,image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg9NAukUtSix30gj4bqEQZ9tgBfBnU/StaSdPhp7xpjkNJ1xXO6nljWXkjVxOyaBPFdRUr5J5RRBthnm22+YQEbb0Fd8CltOoMITIi7FNHiWMReSWFhHXvjrfMO7e1QdQ==',key_name='tempest-keypair-1623692363',keypairs=<?>,launch_index=0,launched_at=2023-07-27T14:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99080d53a44d4aafb4db49b58007653e',ramdisk_id='',reservation_id='r-9jnxqxvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='33cbcfd9-c349-4c50-a3d9-7b9d8aca3776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1123819080',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1123819080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T14:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='224a0c3b1ac7497b874c68eb18048d0f',uuid=24d311bc-2e9b-4bc6-9ede-3d38620d4157,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Converting VIF {"id": "decc6867-e855-477d-b786-e39d0e8e4b02", "address": "fa:16:3e:90:74:ff", "network": {"id": "c9519a4e-63c2-4de4-8bb5-4882ce318381", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-874533826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99080d53a44d4aafb4db49b58007653e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecc6867-e8", "ovs_interfaceid": "decc6867-e855-477d-b786-e39d0e8e4b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG nova.network.os_vif_util [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:74:ff,bridge_name='br-int',has_traffic_filtering=True,id=decc6867-e855-477d-b786-e39d0e8e4b02,network=Network(c9519a4e-63c2-4de4-8bb5-4882ce318381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecc6867-e8') {{(pid=70914) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG os_vif [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:74:ff,bridge_name='br-int',has_traffic_filtering=True,id=decc6867-e855-477d-b786-e39d0e8e4b02,network=Network(c9519a4e-63c2-4de4-8bb5-4882ce318381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecc6867-e8') {{(pid=70914) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdecc6867-e8, bridge=br-int, if_exists=True) {{(pid=70914) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:26 user nova-compute[70914]: INFO os_vif [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:74:ff,bridge_name='br-int',has_traffic_filtering=True,id=decc6867-e855-477d-b786-e39d0e8e4b02,network=Network(c9519a4e-63c2-4de4-8bb5-4882ce318381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecc6867-e8')
Jul 27 14:14:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Deleting instance files /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157_del
Jul 27 14:14:26 user nova-compute[70914]: INFO nova.virt.libvirt.driver [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Deletion of /opt/stack/data/nova/instances/24d311bc-2e9b-4bc6-9ede-3d38620d4157_del complete
Jul 27 14:14:26 user nova-compute[70914]: INFO nova.compute.manager [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 27 14:14:26 user nova-compute[70914]: DEBUG oslo.service.loopingcall [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70914) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG nova.compute.manager [-] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Deallocating network for instance {{(pid=70914) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] deallocate_for_instance() {{(pid=70914) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 14:14:26 user nova-compute[70914]: DEBUG nova.network.neutron [-] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Updating instance_info_cache with network_info: [] {{(pid=70914) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 14:14:26 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Took 0.84 seconds to deallocate network for instance.
Jul 27 14:14:26 user nova-compute[70914]: DEBUG nova.compute.manager [req-4e813e0f-e73f-416b-be1c-0bc666f1cd7c req-b124876a-eb90-4335-89bf-3b07a66455da service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received event network-vif-deleted-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:14:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:14:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:14:27 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:14:27 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:14:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:14:27 user nova-compute[70914]: INFO nova.scheduler.client.report [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Deleted allocations for instance 24d311bc-2e9b-4bc6-9ede-3d38620d4157
Jul 27 14:14:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-97705de0-4681-4d98-9c0f-ebdff687d966 tempest-TestServerVolumeAttachmentScenario-1123819080 tempest-TestServerVolumeAttachmentScenario-1123819080-project-member] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.013s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:14:27 user nova-compute[70914]: DEBUG nova.compute.manager [req-114b2bf7-ac59-4984-98a8-072efe41f076 req-8ac2594d-820b-4d0e-a1a8-155b0152ac00 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received event network-vif-plugged-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 14:14:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-114b2bf7-ac59-4984-98a8-072efe41f076 req-8ac2594d-820b-4d0e-a1a8-155b0152ac00 service nova] Acquiring lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:14:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-114b2bf7-ac59-4984-98a8-072efe41f076 req-8ac2594d-820b-4d0e-a1a8-155b0152ac00 service nova] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:14:27 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [req-114b2bf7-ac59-4984-98a8-072efe41f076 req-8ac2594d-820b-4d0e-a1a8-155b0152ac00 service nova] Lock "24d311bc-2e9b-4bc6-9ede-3d38620d4157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:14:27 user nova-compute[70914]: DEBUG nova.compute.manager [req-114b2bf7-ac59-4984-98a8-072efe41f076 req-8ac2594d-820b-4d0e-a1a8-155b0152ac00 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] No waiting events found dispatching network-vif-plugged-decc6867-e855-477d-b786-e39d0e8e4b02 {{(pid=70914) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 14:14:27 user nova-compute[70914]: WARNING nova.compute.manager [req-114b2bf7-ac59-4984-98a8-072efe41f076 req-8ac2594d-820b-4d0e-a1a8-155b0152ac00 service nova] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Received unexpected event network-vif-plugged-decc6867-e855-477d-b786-e39d0e8e4b02 for instance with vm_state deleted and task_state None.
Jul 27 14:14:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:40 user nova-compute[70914]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690467265.9811804, 24d311bc-2e9b-4bc6-9ede-3d38620d4157 => Stopped> {{(pid=70914) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 14:14:40 user nova-compute[70914]: INFO nova.compute.manager [-] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] VM Stopped (Lifecycle Event)
Jul 27 14:14:41 user nova-compute[70914]: DEBUG nova.compute.manager [None req-b442b66e-c47c-45b1-b151-05a9bc6ddc56 None None] [instance: 24d311bc-2e9b-4bc6-9ede-3d38620d4157] Checking state {{(pid=70914) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 14:14:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:14:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:14:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:14:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:14:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:14:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:14:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:07 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:15:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:12 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:15:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:15:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:15:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:15:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:15:12 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:15:12 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:15:12 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8942MB free_disk=25.255725860595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:15:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:15:12 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:15:13 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:15:13 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:15:13 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:15:13 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:15:13 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:15:13 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:15:15 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:15:15 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:15:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:15:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:17 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:15:19 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:15:20 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:15:20 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:15:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:21 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:15:22 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:15:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:15:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 14:15:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 14:15:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:15:30 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:34 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:15:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70914) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 14:15:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:15:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70914) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 14:15:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:15:51 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:15:56 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:16:01 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:16:06 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:16:08 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:16:11 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:16:14 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager.update_available_resource {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:16:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:16:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:16:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:16:14 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Auditing locally available compute resources for user (node: user) {{(pid=70914) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 14:16:14 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:16:14 user nova-compute[70914]: WARNING nova.virt.libvirt.driver [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 14:16:14 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=25.253543853759766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70914) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 14:16:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 14:16:14 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 14:16:15 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 14:16:15 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70914) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 14:16:15 user nova-compute[70914]: DEBUG nova.compute.provider_tree [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed in ProviderTree for provider: 28f9fcbc-7a25-483f-af71-8564174ecae0 {{(pid=70914) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 14:16:15 user nova-compute[70914]: DEBUG nova.scheduler.client.report [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Inventory has not changed for provider 28f9fcbc-7a25-483f-af71-8564174ecae0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70914) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 14:16:15 user nova-compute[70914]: DEBUG nova.compute.resource_tracker [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Compute_service record updated for user:user {{(pid=70914) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 14:16:15 user nova-compute[70914]: DEBUG oslo_concurrency.lockutils [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=70914) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 14:16:16 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:16:16 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:16:16 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:16:17 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:16:18 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:16:21 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:16:21 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:16:21 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:16:22 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:16:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Starting heal instance info cache {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 14:16:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Rebuilding the list of instances to heal {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 14:16:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Didn't find any instances for network info cache update. {{(pid=70914) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 14:16:22 user nova-compute[70914]: DEBUG oslo_service.periodic_task [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70914) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 14:16:22 user nova-compute[70914]: DEBUG nova.compute.manager [None req-724c3369-13bc-4889-bbf9-60c1568104be None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70914) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 14:16:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 14:16:26 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:16:31 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:16:36 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:16:41 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 14:16:46 user nova-compute[70914]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70914) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}